LIBRARY 

RESEARCH  REPORTS  DIVISION 
NAVAL  POSTGRADUATE  SCHOOL 
MONTEREY,  CALIFORNIA  93940 


LIBRARY 


NAVAL  POSTGRADUATE  SCHOOL 
MONTEREY,  CALIFORNIA  93940 


NPS-54-86-011 


NAVAL  POSTGRADUATE  SCHOOL 

Monterey,  California 


TESTS  OF  THE  USEFULNESS  OF  ANALYST  EARNINGS 
FORECAST  DATA  IN  PREDICTING  BANKRUPTCY 
OF  PUBLIC  CORPORATIONS 


by 


f   0.  Douglas  Moses 


i 


October  1986 


PedDocs 
D  208.14/2 

NPS-54-86-011 


Approved  for  public  release;  distribution  unlimited 

Prepared  for:   Chief  of  Naval  Research 

Arlington,  VA  22217 


TtdbotA 


c.y 


AVAL  POSTGRADUATE  SCHOOL 
Monterey,  California 


RADM.  R.  C.  Austin 
Superintendent 


David  A .  Schrady 
Provost 


The  research  summarized  herein  was  supported  by  the  Foundation 
Research  Program  of  the  Naval  Postgraduate  School  with  funds 
provided  by  the  Chief  of  Naval  Research. 

Reproduction  of  all  or  part  of  this  report  is  authorized. 


This  report  was  prepared  by: 


ICLASSIFIED   ■ 

■{)R\jy   Q  ASSiF'CAriON  Of    ThiS    PAGE 


DUDLEY  KNOX  LIBRARY 


REPORT  DOCUMENTATION  PAGE         NAVAL  POSTGRADUATE  SCHOOL 
tNlADUN  PAbfc         MQNTEREY  CA  93943.51Q1 


REPORT  SECURITY  CLASSIFICATION 
UNCLASSIFIED 


l<5    RESTRICTIVE    MARKINGS 


SECURITY  CLASSIFICATION  AUTHORITY 


DECLASSIFICATION  /DOWNGRADING   SCHEDULE 


i     DISTRIBUTION/ AVAILABILITY  OF   REPORT 

Approved  for  public  release;  distribution 
unlimited. 


PERFORMING  ORGANIZATION  REPORT  NUMBER(S) 


NPS-54-fifi-nn 


S     MONiTOHiNCi   ORGANIZATION    RtF'OKT    NUMfleRiS) 


NAME  OF  PERFORMING  ORGANIZATION 

Naval  Postgraduate  School 


60    OFFiCE   SYMBOL 
(if  appncaoie) 

54 


7  a    NAME    OF    MONiTORiNG   OFKjAiSiiZAfiON 


ADDRESS  (Gfy,  State.  and  ZIP Code) 


Monterey,  CA.  93943 


7b     ADDRESS  (C/ry.   State,   and  IIP  Code) 


NAME  OF  FUNOING/ SPONSORING 
ORGANIZATION 

Naval  Postgraduate  School 


80    OFFICE  SYMBOL 
(//  applicable) 

54 


9    PROCUREMENT   INSTRUMENT   IDENTIFICATION   NUMBER 


N0001486WR4E001 


ADDRESS  (City.  State,  and  ZIP  Code) 


Monterey,    CA  9  394  3 


10  source  of  funding  numbers 


PROGRAM 
ELEMENT  NO 

61152N 


PROJECT 
NO 

RR000-01 


TASK 
NO 


10P3-009 


WOR<    UNIT 
ACCESSION   NO 


TITlE  (/nc/uoe  Security  Classification) 

Tests  of  the  usefulness  of  analyst  earnings  forecast  data  in  predicting  bankruptcy  of  public 
corporations  (unclassified)" 


PERSONAL  AUTHOR(S) 


O.  Douglas  Moses 


.   TYPE  OF   REPORT 

Technical 


Ub    TIME  COVERED 
FROM   Oct    85      to  Oct    86 


14    DATE  OF  REPORT    (Year.  Month.  Day) 

October   1986 


15     PAGE-  COUNT 
124 


SUPPLEMENTARY   NOTATION 


COSATI  COOES 


FIELD 


GROUP 


SUB-GROUP 


18    SUBJECT  TERMS  (Continue  on  reverse  it  necessary  and  identity  by  block  number) 

Bankruptcy  Prediction 
Earnings  Forecasts 


n 

-1 

0 


ABSTRACT  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 

This  study  investigates  five  properties  of  earnings  forecasts  made  by  financial  analysts  to 
determine  if  systematic  differences  in  these  properties  exists  between  failing  and  healthy 
firms.   The  five  properties  are:  The  level  of  forecasts,  forecast  error,  forecast  bias, 
forecast  dispersion  and  revisions  in  forecasts.   Measures  reflecting  the  five  properties 
are  used  in  models  to  distinguish  failing  and  healthy  firms  and  predict  future  bankruptcy. 


DISTRIBUTION /AVAILABILITY  OF   ABSTRACT 
^UNCLASSIFIED/UNLIMITED       □  SAME  AS   RPT  D  DTiC   USERS 


21    ABSTRACT  SECURITY   CLASSIFICATION 
Unclassified 


NAME   OF   RESPONSIBLE   INDIVIDUAL 

0.    Douglas   Moses 


22D  TELEPHONE  (include  Area  Code) 

408-646-3218 


22c    OFflCE    SYMBOL 
54 


)  FORM  1473.  84  mar 


83  APR  edition  may  t>e  used  until  exnausted 
All  other  editions  are  oosoiete 


SECURITY  CLASSIFICATION  OF  THIS  PAGE 


Tests  o-f  the  Use-fulness  o-f  Analyst  Earnings  Forecast 
Data  in  Predicting  Bankruptcy  of  Public  Corporations, 


by 
Douglas  Moses 


Department  of  Administrative  Sciences 
Naval  Postgraduate  School 
Monterey,  CA.  93943 

October  1986 


Acknowl edqements 


Data  on  earnings  forecasts  used  in  this  study  was  taken  -from 
the  Institutional  Brokers  Estimate  System  (IBES)  published  by 
Lynch,  Jones,  &  Ryan,  New  York.  Access  to  historic  IBES  data 
provided  by  Lynch,  Jones,  &  Ryan  is  greatly  appreciated. 

Support  -for  this  project  was  provided  by  the  Naval  Postgraduate 
School  Foundation  Research  Program,  which  is  -funded  by  the  Office 
of  Naval  Research  and  the  Office  of  Naval  Technology. 


Contents 

I  Introduction  and  Overview  1 

1.1  Introduction  1 

1.2  Background  2 

1.3  Relevance  to  Department  o-f  Defense  4 

1.4  Preview  and  Organization  o-f  Study  5 

II  Data  and  Sample  Information  7 

2.  1  Data  Source  -  IBES  7 
2.2  Sample  8 
2.3"  Matching  Firms  8 
2.4     A  Word  on  Notation  10 

III  Analysis  of  the  Properties  of  Analysts 

Earnings  Forecasts  12 

3.  1     Introduction  12 

3.2  The  Concept  of  Rationality  12 

3.3  Systematic  Error— Bias  14 

3.3.1  Comparison  of  Errors  15 

3.3.2  Regression  Tests  —  Full  Sample  26 

3.3.3  Regression  Tests  —  by  Group  29 

3.4  Incorporation  of  Avail ible  Information  33 

3.4.1  Past  Earnings  33 

3.4.2  Past  Forecast  Errors  36 

3.5  Accuracy  of  Analysts  Forecasts  43 

3.5.1  Failing  vs.  Healthy  Firms  44 

3.5.2  Analysts  vs.  Naive  Models  45 

3.6  Dispersion  of  Forecasts  53 
3.6.1   Dispersion  Measures  54 


3.6.2   Dispersion  Tests  55 

3.7  Revisions  in  Forecasts  58 

3.7.1  Revision  Measures  60 

3.7.2  Revision  Tests  61 

3.8  Mean  Forecast  Values  64 

3.9  Intra— year  Changes  66 

3.9.1  Measures  -for  Intra-year  Changes  69 

3.9.2  Tests  o-F  Inter-year  Changes  71 

3. 10  Inter-year  Trends  78 
3.  10.  1  Tests  o-f  Inter-year  Trends  81 

3. 11  Summary  89 

IV    Tests  o-f    Discrimination  and  Prediction  92 

4.1  Introduction  92 

4.2  Selecting  Measures  92 

4.3  Univariate  Analysis  96 

4.4  Multiple  Discriminant  Models  103 

4.5  Conclusions  112 
References  116 


EXECUTIVE  SUMMARY 

The  purpose  of  this  study  is  to  determine  if  various  measures 
developed  from  financial  analysts  forecasts  of  earnings  for  firms 
can  be  exploited  in  predicting  future  bankruptcy.  The  analysis 
consists  of  two  major  parts. 

In  the  first  part  the  properties  of  analysts  forecasts  are 
discussed  and  measures  are      developed  to   reflect  these  properties. 
Five  properties  are    investigated:  forecast  level,  forecast  disper- 
sion,  forecast   error,   forecast   bias   and    forecast   revisions. 
Various  tests   are  conducted   to  determine   if  there  are    systematic 
differences  in  the  properties   for   failing   firms   as   compared  to 
healthy   firms   in   years   prior   to   the  bankruptcy  of  the  failing 
firms.   Several  statistically  significant  differences  are  apparent. 
Failing  firms  tend  to  be  associated  with  lower  forecasted  earnings, 
higher  dispersion  in  earnings   forecasts   across   multiple  forecas- 
ters,  greater   error   in  forecasts,  over — optimistic  forecasts,  and 
greater  frequency   of   downward   revisions   in   forecast  estimates. 
Some   differences   between   failing   and   healthy   firms  in  how  the 
properties  change,  both  within  years   and   across   years,   are  also 
apparent. 

In  the  second  part  of  the  study,  measures  reflecting  aspects 
of  the  five  properties  are  used  to  discriminate  failing  from 
healthy  firms.  Both  univariate  and  multivariate  approaches  are 
attempted.  Single  measures  and  linear  combinations  of  measures  are 
able  to   out-predict  a   naive  model,   which  classifies  all  firms  as 


healthy,  in  distinguishing  between  groups.  However,  overall 
results  are  not  encouraging.  It  is  possible  to  develop  multi- 
variate models  that  are  highly  successful  in  classifying  -firms  but 
these  models  are  unstable  when  applied  to  data  taken  -from  different 
years  prior  to  bankruptcy  and  are  of  questionable  validity. 
Individual  measures  are  more  stable  across  time  in  identifying 
failing  firms  from  healthy  firms  but  classification  success  is  not 
impressive.  Perhaps  the  single  best  approach  identified  for  using 
measures  taken  from  analyst  forecasts  for  predicting  failure  is  to 
look  at  the  mean  forecasted  value  of  future  earnings.  Simply  put 
failing  firms  are  predicted  to  have  lower  earnings.  An  approach  in 
which  firms  with  forecasted  earnings  below  a  particular  cutoff 
point  are  classified  as  facing  bankruptcy  is  able  to  correctly 
classify  from  22%  to  40%  (depending  on  the  year  prior  to  bank- 
ruptcy) of  firms  that  are  mi sclassif ied  using  the  naive  rule.  While 
the  results  indicate  some  ability  of  earnings  forecast  data  to 
assist  in  the  prediction  of  failure,  the  ability  to  exploit  analyst 
forecast  data  to  assist  in  predicting  failure  does  not  appear  to  be 
great.  The  fact  that  there  i s  an  association  between  low  forecas- 
ted future  earnings  and  future  bankruptcy  is  not  surprising  and 
does  not  appear  to  provide  any  novel  insight  that  may  be  exploited 
for  predicting  bankruptcy. 


CHAPTER  I 
INTRODUCTION  AND  OVERVIEW 

1.1   Introduction 

Corporate  bankruptcy,  -failure  or  distress  can  result  in 
considerable  costs  to  management,  investors,  creditors  and  custo- 
mers. The  prediction  of  corporate  failure  ex  ante  can  provide  the 
time  to  react  and  minimize  those  costs.  The  most  common  source  o-f 
information  for  assessing  financial  health  and  developing  models  to 
predict  failure  is  corporate  accounting  reports.  Several  studies 
have  used  statistical  techniques  to  assess  the  ability  of  combina- 
tions of  accounting  ratios  to  predict  bankruptcy.  Variables  used 
in  prediction  models  typically  included  liquidity  and  solvency 
ratios,  and  performance  and  funds  flow  measures.  These  studies 
used  different  ratios  and  different  analytical  techniques,  and 
achieved  varying  levels  of  predictability;  but  each 

relied  on   accounting   information.     (See   Zavgren   C1983]   for  a 
review. ) 

There  are,  however,  several  weakness  to  the  use  of  accounting 
data  to  predict  corporate  failure.  Accounting  data  is  produced 
only  periodically,  is  historical  rather  than  prospective,  and 
reflects  events  that  Are  primarily  endogenous  to  the  firm. 
Accounting  measures  ^re  sensitive  to  the  choice  of  accounting 
procedures,  subject  to  "window  dressing",  and  inevitable  vary  in 
magnitude  across  firms  and  industries  as   a  function   of  the  nature 


o-f  operations  and  technology.  In  addition,  because  o-f  interrela- 
tionships between  measures,  researchers  have  found  that  individual 
ratios  ^re    inconsistent  predictors  across  tests  and  samples. 

This  study  investigates  the  use-fulness  o-f  another  approach  to 
the  prediction  o-f  corporate  failure,  one  involving  the  use  of  non- 
accounting  information,  specifically  financial  analysts  forecasts 
(FAF)  of  a  firm's  future  earnings.  The  purpose  is  to  see  if 
measures  developed  from  analysts  forecasts  of  earnings  can  be 
exploited  to  predict  bankruptcy. 

1 . 2  Background 

Earnings  are  considered  by  investors  and  analysts  to  be  the 
most  preferred  expectational  data  (Change  and  Most  C1980D)  and  have 
the  greatest  information  content  of  various  accounting  variables 
(Gonedes  C19743);  thus  there  tends  to  be  special  importance 
attached  to  the  information  reflected  in  earnings.  Various  studies 
of  financial  analysts  forecasts  of  earnings  have  been  conducted 
(See  Givoly  and  Lakonishok  [19843  for  review).  Several  qualities 
of  FAF  suggest  their  usefulness  as  an  information  source  and  their 
potential  ability  to  aid  in  failure  prediction.  FAF  tend  to 
outperform  mechanical  models  based  on  past  historical  earnings  in 
predicting  future  earnings  (Barefield  and  Comiskey  [19753;  Collins 
and  Hopwood  [19803;  Fried  and  Givoly  [19823).  This  superiority  is 
more  pronounced  in  years  where  there  is  a  turning  point  in  the 
earnings  trend  (Barefield  and  Comiskey).  FAF  apparently  contain 
information  not   captured  by   historical  trends   in  earnings  (Fried 


and  Givoly)  and  may  re-flect  inside  information  (Abdel-khal  i  k  and 
Ajinkya  C19823).  Analysts  revise  their  -forecasts  in  response  to 
information  contained  in  quarterly  earnings  announcements  (Brown 
and  Roze-f-f  C1979U)  but  the  trend  o-f  FAF  is  smoother  than  actual 
trends  (Crichf ield,  Dyckman  and  Lakonishok  C19783),  suggesting  that 
analysts  separate  a  permanent  from  a  temporary  component  in 
reported  earnings  numbers.  Studies  have  indicated  an  association 
of  FAF  and  revisions  in  FAF  with  stock  prices  (Neiderhof f er  and 
Regan  C1972H,  Givoly  and  Lakonishok  C 1979, 19803,  Elton,  Gruber  and 
Gultekin  C19813,  Brown,  Foster  and  Noreen  C19853).  Securities 
trading  strategies  using  FAF  and  revisions  in  FAF  indicate  that  FAF 
have  information  content  for  the  securities  market  (Givoly  and 
Lakonishok  C19803,  Abdel-khalik  and  Ajinkya).  Furthermore,  FAF 
appear  to  be  a  more  adequate  surrogate  for  the  securities  market 
earnings  expectations  than  are  naive  predictions  based  on  histor- 
ical earnings  (Malkiel  [197011,  Malkiel  and  Cragg  C19703,  Fried  and 
Givoly  C19823).  Collectively  these  findings  indicate  that  FAF  are 
a  useful,  comprehensive  piece  of  information  which  reflect  infor- 
mation exogenous  to  firms'  accounting  systems. 

Of  particular  interest  in  the  context  of  bankruptcy  predic- 
tion ^re  measures  of  risk  derived  from  FAF.  The  error  in  earnings 
forecasts  has  been  shown  analytically  to  be  an  appropriate  indica- 
tor of  uncertainty  (Cukierman  and  Givoly  C19823).  The  dispersion 
of  forecasts  across  analysts  and  the  unpredictability  of  earnings 
have  been  shown  empirically  to  be  associated  with  traditional  risk 
measures  such  as  beta  and  the  standard  deviation  of  returns  (Givoly 


and  Lakonishok  C19833).  In  addition  the  dispersion  of  FAF  has  been 
shown  to  be  superior  to  measures  of  beta,  economy  risk,  information 
risk,  and  interest  rate  risk  in  explaining  expected  return  (Malkiel 
C19813).  In  short,  dispersion  and  unpredictability  in  FAF  may 
serve  as  use-ful  proxies  -for  risk.  Such  measures  may  be  o-f  "unique 
value  to  empirical  researchers"  because  unlike  most  traditional 
risk  measures,  these  a.re  "ex  ante"  measures  o-f  risk  (Givoly  and 
Lakonishok  [19843). 

In  summary,  past  attempts  to  predict  corporate  -failure  have 
in  general  relied  on  accounting  data,  which  is  historical,  reflec- 
tive o-f  information  primarily  endogenous  to  the  firm,  subject 
confounding  influences  such  as  manipulation  and  the  choice  of 
accounting  procedures,  and  provided  only  periodically.  Financial 
analysts  forecasts  Are  prospective,  reflective  of  a  broad  informa- 
tion set,  and  provided  and  revised  in  a  timely  manner.  FAF  can  be 
expected  to  reflect  macro-economic  events,  industry  expectations 
and  f i rm— specif ic  non— accounting  information  (e.g.  contracts,  order 
backlogs,  capital  expenditures).  Research  has  indicated  that  FAF 
and  risk  measures  developed  from  FAF  have  useful  information 
content. 

1 . 3   Relevance  to  Department  of  Defense 

The  Department  of  defense  continually  contracts  with  corpora- 
tions to  provide  material,  equipment  and  services.  Corporate 
failure  or  distress  frequently  leads  to  contract  terminations, 
which  can   impose  direct   costs  on  the  Department  of  Defense  in  the 


-form  of  increased  legal  and  administrative  expenditures,  and 
indirect  costs  in  the  -form  o-f  delays  or  failure  to  perform  con- 
tracted activities.  The  ability  to  predict  or  anticipate  corporate 
distress  has  obvious  implications  for  contracting  with  corporate 
organizations,  the  procurement  of  goods  and  services  from  the 
private  sector,  and  the  management  of  existing  contracts. 

1 . 4   Preview  and  organization  of  the  study 

The  objective  of  this  study  is  to  empirically  investigate  the 
potential  usefulness  of  measures  developed  from  financial  analysts 
forecasts  of  earnings  in  predicting  corporate  bankruptcy.  In 
general  the  approach  used  is  to  identify  a  sample  of  failed  firms 
and  a  matched  sample  of  non-failed  firms,  to  create  measures  of 
various  properties  of  analysts  earnings  forecasts,  and  to  test  the 
ability  of  the  measures  to  discriminate  between  the  two  groups  of 
firms.  The  remainder  of  the  study  consists  of  three  chapters. 
Chapter  2  provides  information  on  sample  firms  and  sample  selection 
procedures,  and  information  about  the  data  source  used  to  develop 
measures  related  to  analysts  forecasts  of  earnings. 

Chapter  3  draws  on  the  results  of  previous  research  to 
identify  properties  of  analysts  forecasts.  Five  properties  of 
forecasts  are  addressed:  forecast  level,  forecast  error,  forecast 
bias,  forecast  dispersion,  and  revisions  in  forecasts.  Measures 
reflecting  each  property  are  developed.  Tests  are  conducted  to 
determine  if  these  five  properties  of  forecasts  differ  systematic- 
ally  between    failing   and    healthy   firms   in   years   prior   to 


bankruptcy.  Tests  are  also  conducted  to  determine  i f  there  are 
systematic  differences  in  the  way  measures  reflecting  these 
properties  change  both  within  years  and  across  years.  The  identi- 
fication of  systematic  differences  in  properties  of  forecasts 
provide  the  basis  for  assuming  that  measures  reflecting  these 
properties  may  be  useful  in  distinguishing  failing  from  healthy 
f i  rms. 

Chapter  4  uses  a  subset  of  measures  in  an  attempt  to  distin- 
guish failing  from  healthy  -firms.  Both  univariate  and  multi- 
variate approaches  to  discrimination  are  used.  In  the  univariate 
approach  sample  firms  a.re  rank  ordered  on  individual  measures  and  a 
threshold  or  cutoff  value  of  a  measure  is  selected  to  classify 
firms  into  groups.  In  the  multivariate  approach  stepwise  multiple 
discriminant  analysis  is  used  to  construct  linear  combinations  of 
measures  that  provide  a  discriminant  score  to  be  used  in  classify- 
ing firms  into  groups.  Various  validation  tests  of  the  approaches 
arB  presented  and  conclusions  concerning  the  overall  usefulness  of 
analyst  forecast  information  in  predicting  bankruptcy  a.re    offered. 


CHAPTER  2 
DATA  AND  SAJ1PLE  INFORMATION 

2.  1   The  Data  Source  -  IBES 

The  data  source  -for  analyst  earnings  -forecasts  was  the 
Institutional  Brokers  Estimate  System  (IBES)  published  by  Lynch, 
Jones,  and  Ryan,  a  New  York  based  brokerage  -firm.  IBES  is  avail- 
able in  both  manual  and  machine— readabl e  -form  in  monthly  issues. 
An  historical  summary  data  tape  covering  each  month  -from  January 
1976  through  July  19B5  was  made  available  by  Lynch,  Jones,  and 
Ryan.  Earnings  -forecast  data  -for  4305  -firms  were  available  on  the 
IBES  tape.  However,  the  period  covered  on  the  tape  -for  individual 
firms  ranged  -from  one  month  to  the  maximum  possible  nine  years,  six 
months. 

IBES  contains  summary  statistics  related  to  annual  earnings- 
per— share  -forecasts  up  to  two  years  prior  to  the  announcement  o-f 
the  actual  earnings  number  -from  multiple  forecasters  who  report 
their  predictions  to  the  IBES  service.  Each  month  IBES  provides 
information  on  the  mean  estimate,  median  estimate,  high  estimate, 
low  estimate,  standard  deviation  of  estimates,  number  of  upward 
revisions  since  the  previous  month,  number  of  downward  revisions, 
as  well  as  various  other  data  such  as  monthly  stock  price  and 
adjustment  factors  related  to  stock  splits.  A  more  detailed 
discussion  of  the  IBES  data  source  is  provided  in  Faster  C19S6H  or 
Brown,  Foster  and  Noreen  C1985D. 


2. 2   Sample 

The  -first  step  was  to  develop  a  list  o-f  bankrupt  firms.  The 
primary  source  used  was  the  F&S  Index  of  Corporate  Changes,  volumes 
-from  January  1977  through  September  1985  inclusive.  Lists  o-f 
bankrupt  firms  provided  in  Altman  C1983]  and  Zavgren  C19833,  as 
well  as  the  Wal 1  Street  Journal  Index  from  1977  through  1984,  were 
also  reviewed.  All  firms  listed  in  these  sources  declaring  either 
chapter  X  or  chapter  XI  bankruptcy  were  eligible  for  inclusion. 

The  list  of  bankrupt  firms  was  cross-referenced  with  firms  on 
the  IBES  tape.  The  IBES  tape  contained  98  firms  that  were  identi- 
fied as  having  declared  bankruptcy.  Thirteen  firms  were  dropped 
because  only  data  for  months  following  bankruptcy  were  included  on 
the  IBES  tape.  Eighteen  additional  firms  were  dropped  because  the 
number  of  months  of  coverage  on  the  tape  was  considered  too  short 
(less  than  four  months).  Thus  the  sample  used  in  the  study 
consists  of  68  firms  declaring  bankruptcy  during  the  period  January 
1977  to  September  1985. 

2. 5   Matching  Firms 

Each  bankrupt  firm  was  matched  with  a  non— bankrupt  firm  from 
the  same  industry  and  of  approximately  the  same  size.  The  proce- 
dure for  matching  was  as  follows:  The  annual  Wards  Directory  of 
Leading  U. S.  Corporations  was  examined  two  years  before  bankruptcy 
(the  middle  of  the  test  period)  for  each  bankrupt  firm.  Wards 
lists  firms  by  three  digit  SIC  codes.  The  firm  within  the  same 
industry  (same  SIC  code)  closest   to   the   bankrupt   firm   in  total 
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asset  size  was  identified  as  a  tentative  match.  The  tentative 
matching  -Firm  was  accepted  i-f  it  was  included  on  IBES  and  had  data 
coverage  overlapping  the  months  covered  -for  the  bankrupt  -firm.  If 
not,  the  -firm  in  the  Wards  directory  next  closest  in  size  to  the 
bankrupt  -firm  was  identified  as  a  tentative  match.  The  process  of 
cross  referencing  Wards  and  IBES  was  continued  until  a  match  for 
each  bankrupt  firm  was  accepted. 

Matching  on  industry  is  desirable  to  control  for  industry 
characteristics  and  conditions.  Forecast  uncertainty  may  be 
related  to  industry.  Furthermore,  information  events  may  have 
industry-wide  implications  leading  to  i ndustry— wide  revisions  in 
earnings  forecasts.  Using  two  digit  SIC  codes,  29  different 
industries  ^re    represented  in  the  sample. 

Matching  on  size  is  desirable  because  size  is  associated  with 
risk,  probability  of  bankruptcy,  analyst  attention,  and  most 
likely,  the  number  of  sources  from  which  consensus  forecasts  and 
summary  statistics  on  the  IBES  tape  3ire  developed.  Using  total 
assets  as  a  measure  of  size,  58/C  (42/C)  of  bankrupt  firms  were 
larger  (smaller)  than  their  non-bankrupt  matched  firm.  Using  total 
sales  as  a  measure,  50X  of  bankrupt  firms  were  larger  than  their 
non— bankrupt  match.  Both  parametric  (t— test)  and  non-parametric 
(wilcoxon  sign  rank)  tests  revealed  no  significant  difference  in 
mean  size  between  bankrupt  and  non-bankrupt  groups,  so  the  matching 
process  was  apparently  successful. 

The  68  matched  pairs  represent  the  maximum  sample  available 
for  the  analysis  conducted.   However,   data  for   each  firm   was  not 


available  on  IBES  -for  each  month  and  year  o-f  the  test  period.  In 
addition,  in  some  months  where  data  was  available,  IBES  included 
-forecasts  -from  only  one  analyst  while  certain  measures  used  in  the 
analysis  (e.g.  standard  deviation  o-f  multiple  -forecasts)  required 
-forecasts  from  more  than  one  source.  Consequently,  many  individual 
tests  were  conducted  on  sample  sizes  less  than  68. 

Matching  on  -fiscal  year— end  would  perhaps  be  desirable  but 
was  not  possible  without  a  great  reduction  in  sample  size.  Data 
•for  each  -firm  in  a  given  matched  pair  were  however  taken  -from  the 
same  -fiscal  year.  Within  a  given  year  there  is  substantial 
evidence  that  the  properties  o-f  analysts  -forecasts  change  as  the 
year-end  approaches.  For  example  forecasts  tend  to  become  more 
accurate  as  the  end  of  a  reporting  year  approaches.  However,  data 
in  the  study  is  analyzed  in  "event"  time  rather  than  "calendar" 
time,  which  minimizes  any  problem  associated  with  firms  having 
different  fiscal  year  ends. 

2.4   A  Word  on  Notation 

Notation  used  in  the  study  also  refers  to  event  time.  Two 
events  ^re  of  importance:  the  year  in  which  bankruptcy  is  declared 
for  the  bankrupt  firm  and  the  month  relative  to  fiscal  year-end 
within  any  year.  The  notation  used  treats  bankruptcy  as  time 
"zero"  and  counts  backward  in  time  such  that  both  years  and  months 
increase  as  the  time  before  bankruptcy  or  year— end  increases.  Year 
zero  is  the  year  in  which  bankruptcy  is  declared  for  a  bankrupt 
firms  (and  the   corresponding   fiscal   year   for   the  corresponding 
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healthy  -firm  in  a  matched  pair).  Year  one  is  the  -fiscal  year 
immediately  prior  to  the  year  in  which  bankruptcy  is  declared. 
Year  two  is  two  years  prior  to  the  year  in  which  bankruptcy  is 
declared,  and  so  on.  Within  any  given  -fiscal  year,  month  zero  is 
the  last  month  in  the  year  (e.g.  December  -for  a  -firm  with  December 
31  year-end).  Month  one  is  one  month  prior  to  year-end  (e.g. 
November),  and  so  on.  Since  forecast  data  is  available  -for  up  to 
two  years  prior  to  the  end  o-f  a  given  forecast  year,  months  are 
numbered  0  through  23. 

One  other  date  is  also  re-ferr&d  to  in  the  study:  the  month  of 
the  public  announcement  of  a  firms'  annual  earnings  number.  For 
most  firms  this  is  one  to  three  months  after  the  end  of  a  fiscal 
year.  For  purposes  of  this  study  the  month  in  which  a  firms  actual 
reported  earnings  number  is  available  on  the  IBES  tape  is  consid- 
ered the  month  of  the  announcement.  The  notation  "PA",  standing 
for  "prior  to  announcement"  refers  to  the  month  immediately 
preceding  the  month  of  announcement.  This  will  vary  from  firm  to 
firm.  It  represents  the  time  of  the  last  available  earnings 
forecast  information  prior  to  the  release  of  the  actual  reported 
earni  ngs. 
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CHAPTER  3 
ANALYSIS  OF  THE  PROPERTIES  OF  ANALYSTS  EARNINGS  FORECASTS 

5.1  Introduction- 

This  chapter  identifies  observable  properties  of  analysts 
-forecasts  and  tests  -for  systematic  differences  in  these  properties 
between  failing  and  healthy  firms.  The  five  properties  addressed 
Are  1.  systematic  error  or  bias  in  forecasts,  2.  forecast  accuracy, 
3.  dispersion  in  forecasts  across  different  analysts,  4.  the 
frequency  of  revisions  in  forecasts  by  analysts,  and  5.  the  level 
of  the  mean  or  average  forecast  by  the  analysts.  Both  forecast 
bias  and  forecast  accuracy  relate  to  the  issue  of  whether  earnings 
forecasts  ^re  "rational".  Givoly  and  Lakonishok  C 19843  state  that 
rational  forecasts  should  be  unbiased,  should  incorporate  all 
available  relevant  information,  and  should  be  most  accurate.  Thus 
the  concept  of  rationality  is  discussed  and  the  incorporation  of 
available  information  in  analysts  forecasts  is  also  addressed. 

3.2  The  Concept  of  Rationality 

Recent  studies  (e.g.  Critchfield,  Dyckman  and  Lakonishok 
[ 19783  and  Givoly  E 19853)  have  explored  the  nature  of  the  formation 
of  analysts  earnings  forecasts,  with  emphasis  on  their  rationality. 
The  importance  of  rationality  of  earnings  expectations  and  its  link 
to  stock  market  efficiency  is  expressed  by  Givoly  and  Lakonishok 
C19843: 
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Evidence  o-f  rational  earnings  forecasts  would  be 
consistent  with  both  the  finding  o-f  stock  market 
e-f-ficiency  and  the  important  role  o-f  earnings  in 
stock  valuation.   Findings  o-f  irrational  -forecasting 
by  analysts  would  be  inconsistent  with  stock  market 
e-f-ficiency  unless  either  FAF  do  not  represent  the 
true  market  expectations  or  earnings  expectations  do 
not  play  the  role  envisioned  -for  them  by  the  various 
valuation  models,  (p.  127) 

In  principle,  rationality  o-f  a  -forecasted  measure  (such  as  earni- 
ngs) means  that  future  expectations  of  the  measure  of  interest  are 
generated  by  the  same  stochastic  process  that  generates  the  actual 
measure  (Muth  C19613).  Actual  tests  of  rationality  have  generally 
applied  a  weaker  requirement  that  future  expectations  fully 
incorporate  the  information  available  in  the  past  historical  series 
of  the  measure  of  interest.  Both  Critchfield,  Dyckman  and 
Lakonishok  1 19783  and  Givoly  and  Lakonishok  C19843  offer  two  broad 
testable  implications  of  rationality.  First,  assuming  earnings  to 
be  a  random  variable,  rational  forecasts  should  not  be  expected  to 
be  error  free,  but  should  in  general  be  close  to  the  mean  of  the 
true  probability  distribution.  In  short,  earnings  forecasts  should 
not  reflect  any  systematic  error  or  bias.  Second,  essentially 
costless  information  should  be  impounded  in  the  forecast.  Thus  it 
should  not  be  possible  to  improve  on  the  forecast  by  using  informa- 
tion on  past  earnings  or  forecast  error^f  and  analysts  forecasts 
should  not  be  less  accurate  than  forecasts  based  solely  on  past 
earnings.  Investigations  of  these  two  implications  of  rationality 
have  failed  to  reject  the  hypothesis  that  financial  analysts 
forecasts  of  earnings  Are  rational  (Critchfield,  Dyckman  and 
Lakonishok   C1978H,   Malkiel   and   Cragg   £198011,   Givoly   C1985D). 
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Evidence  to  date  has  generally  been  consistent  with  the  view  that 
analysts  produce  unbiased  -Forecasts  that  incorporate  available  past 
earnings  information. 

The  following  sections  (3.3-3.5)  present  some  evidence  on  the 
properties  of  analyst  earnings  forecasts  that  relate  to  the  issue 
of  rationality.  The  findings  suggest  the  degree  of  rationality  may 
vary  across  firms  depending  on  financial  health.  The  findings 
indicate  that  the  nature  of  analysts  forecasts  differ  between 
healthy  and  failing  firms,  that  the  assumption  of  complete  ration- 
ality for  failing  firms  may  be  open  to  question  and  that  variables 
related  to  the  rationality  properties  of  forecasts  may  be  useful  to 
identify  failing  firms. 

3. 3   Systematic  Error  -  Bias 

If  forecasts  are  rational  they  should  be  unbiased.  While 
forecasters  cannot  be  expected  to  predict  without  error,  rational 
forecasters  should  in  general  be  able  to  predict  without  systematic 
error.  Consistent  systematic  error  would  be  inconsistent  with 
rationality  since  rational  forecasters  should  use  the  information 
in  past  forecast  errors  to  improve  future  forecasts.  Unbiased 
forecasts  imply  that 

Actual  =  Forecast  +  e 
where  e  is  a  random  error  with  zero  expectation. 

Studies  by  Critchfield,  Dyckman  and  Lakonishok  1119783,  Givoly 
C 19853,  and  Malkiel  and  Cragg  C 1980D  have  examined  analysts 
forecasts  for   bias  and   have  failed   to  reject  the  hypothesis  that 
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-forecasts  sire  unbiased.  (However,  Givoly  and  Lakonishok  C 19843, 
citing  Bare-field  and  Comiskey  C1975H  and  Fried  and  Givoly  C1982D 
conclude  that  there  is  an  "accumulation  o-f  evidence,"  though 
statistically  i  nsi  gni -f  i  cant ,  that  an  upward  bias  may  be  present  in 
analysts  -forecasts.) 

The  -finding  o-f  no  systematic  error  is  consistent  with 
rational  -forecasts  and  with  the  proper  processing  and  utilization 
o-f  information  available  in  the  past  realizations  o-f  earnings  and 
-forecast  errors.  The  immediate  concern  here  is  whether  there  is  a 
difference  in  the  systematic  error  o-f  forecasts  between  healthy  and 
f ai 1 i  ng  f  i  rms. 

5. 3.  1  Comparison  of  Errors 

Various  tests  may  be  conducted  to  assess  the  degree  of  bias 
in  forecasts.  One  approach  is  to  average  forecast  errors  (across 
firms  or  across  time).  If  there  is  a  bias,  the  average  prediction 
error  will  be  significantly  different  from  zero.  Several  measures 
of  forecast  error  were  used  in  this  study: 

The  Relative  Forecast  Error  (RFE)  was  defined  as 

RFE  =(  Y  -  Y)  /  |Yj 
where  Y  is  the  mean  earnings  per  share  forecast  and  Y  the  actual 
realized  EPS.  (The  mean  of  analysts  forecasts  for  a  given  firm  is 
used  throughout  the  study  as  the  average  or  consensus  measure. 
Tests  using  the  median  produced  the  same  findings).  The  RFE  is  the 
"standard"  measure  used  in  previous  studies.  Deflation  by  |Yj  is 
usua.l  1  y  deemed  necessary  to   adjust   for   magnitude   differences  in 
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EPS.  However,  deflation  by  |Y|  may  be  questioned  in  the  context  of 
the  present  study  because  one  might  expect  the  EPS  o-f  -failing  firms 
to  differ  systematically  (smaller,  more  negative)  from  non-failing 
firms.  This  is  not  a  real  problem  if  the  only  objective  is  to 
identify  statistics  that  may  differ  between  the  two  groups.  It  is 
perhaps  a  problem  if  the  objective  is  to  test  a  hypothesis  concer- 
ning "true"  bias.  Consequently,  other  forecast  error  measures  were 
also  used. 

The  Absolute  Forecast  Error  (AFE)  was  defined  as 

AFE  =  (Y  -  Y) 
where  Y  and  Y  are  defined  as  before.  The  AFE  removes  the  problem 
of  inducing  a  bias  through  the  choice  of  a  deflator,  but  implicitly 
assumes  that  sample  firms  are  of  similar  size.  Since  healthy  and 
failing  firms  were  matched  on  size,  use  of  the  AFE  may  be  defensi- 
ble. 

A  third  alternative,  the  Price-deflated  Forecast   Error  (PFE) 
was  defined  as 

PFE  =(Y  -  Y)  /  P 
where  P   is  the  market  price  of  a  share  of  stock  in  the  final  month 
of  the  fiscal  year  for  which  Y  is  the  reported  EPS.    P  is  provided 
on  IBES.    Neiderhoffer  and  Regan  C 19723  argue  that  using  prices  to 
deflate  forecast  errors  is  superior  to  other  approaches 

The  Log  Relative  Forecast  Error  (LFE)  is  defined  as 

LFE  =  In  (Y  /  Y) 
The  LFE  has  been  used  frequently  (e.g.  Givoly   [19853,  Critchfield, 
Dyckman  and  Lakonishok  C19783)  because  of  desirable  properties:   It 
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provides  a  symmetric  distribution  o-f  (positive/negative)  errors  and 
reduces  the  impact  o-f  outliers.  However,  the  LFE  is  undefined  when 
Y  is  negative.  Since  many  -failing  -firms  have  negative  earnings, 
use  o-f  LFE  greatly  reduced  sample  size  in  tests  and  its  use  was 
considered  inappropriate. 

The  Variabi 1 ity— deflated  Forecast  Error  (VFE)  is  defined  as 

A 

VFE  =  (Y  -  Y)  /  Oy 

where  <rv  is  the  standard  deviation  o-f  the  -firms  historical  EPS 
series.  Imho-f-f  C1982H  recommends  deflating  by  crv.  Calculation  of 
(Tv  for  sample  firms  was  generally  not  passible  to  do  to  insuf- 
ficient data  on  IBES.  As  an  alternative,  ov  was  used  as  a  deflator 
where  ov  is  the  cross-sectional  standard  deviation  of  forecasts  for 
an  individual  firm  across  analysts  at  a  point  in  time.  The 
implicit  assumption  when  deflating  by  ov  is  that  earnings  variabil- 
ity over  time  (o-v)  is  reflected  in  dispersion  of  forecasts  (ov). 
Givoly  and  Lakonishok  [1983]  do  provide  empirical  evidence  that 
dispersion  in  forecasts  is  related  to  other  measures  of  risk  such  as 
beta  and  the  standard  deviation  of  returns,  so  the  assumption  may 
not  be  inappropriate.  Deflating  by  ov  is  a  problem  when  the  number 
of  forecasts  available  is  only  one,  which  was  sometimes  the  case 
for  sample  firms.  Thus  use  of  VFE  on  occasion  also  created  sample 
size  problems.  Results  from  tests  using  measures  deflated  by  ov 
were  conducted  but  are  not  reported  in  the  study  because  they 
provide  no  additional  insights  of  interest. 

As  indicated  above,  one  test  of  bias  is   to  determine   if  the 
average   forecast   error   is   significantly   different   from   zero. 
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TABLE  Bl 

FORECAST  ERRORS  BY  GROUP 


Failing  Firms 
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TABLE  B2 
FORECAST  ERRORS  BY  GROUP 
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TABLE  B3 
FORECAST  ERRORS  BY  GROUP 
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TABLE  B4 
FORECAST  ERRORS  BY  GROUP 
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-1.96 

.067 

PA 

.00 

.27 

.788 

0 

.01 

.36 

.720 

3 

-.02 

-1.26 

.219 

6 

-.04 

-1.38 

.  182 

9 

-.06 

—  1 .  35 

.  192 

12 

-.08 

-1.36 

.  196 

AVE 

t 

a 

.02 

-.31 

.761 

.02 

-.21 

.834 

.00 

.02 

.987 

.07 

.51 

.616 

.  18 

1.00 

.325 

.  17 

.81 

.422 

01 

-.30 

.764 

01 

-.29 

.771 

08 

-1.00 

.323 

11 

-.92 

.364 

15 

-.95 

.347 

20 

-1.08 

.286 

00 

.40 

.693 

00 

.74 

.463 

00 

.72 

.476 

01 

1 .  33 

.  190 

02 

1.48 

.  148 

01 

1.  14 

.262 
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Tables  Bl— B4  provide  data  on  average  -forecast  errors  -for  both 
healthy  and  failing  groups  at  three  month  intervals  -for  the  -four 
years  prior  to  bankruptcy.  For  each  group  the  tables  provide 
measures  o-f  the  average  (mean)  -forecast  error  (AFE,  RFE,  PFE)  ,  the 
t-values  -for  the  test  o-f  the  null  hypothesis  that  the  mean  -forecast 
error  is  zero,  and  the  alpha  level  for  rejecting  the  null  hypothe- 
sis. 

For  years  1—3  prior  to  bankruptcy,  several  observations  are 
of  note.  First,  for  both  healthy  and  failing  firms  the  average 
forecast  error  is  generally  negative.  This  is  consistent  with  the 
upward  bias  previously  noted  by  Givoly  and  Lakonishok  C19843. 
Second,  -for  both  groups  the  absolute  magnitude  of  the  forecast 
errors  became  smaller,  closer  to  zero,  as  the  earnings  announcement 
data  approaches.  This  is  consistent  with  previous  findings  and  is 
what  one  would  expect  as  forecasters  update  their  predictions  in 
response  to  developing  information.  Third,  t— values  for  the 
failing  groups  ^re  consistently  larger  (more  negative)  and  signifi- 
cant at  lower  alpha  levels  than  for  the  healthy  group.  Fourth,  for 
forecasts  made  at  year  end  (month  0)  or  just  prior  to  announcement 
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o-f  actual  earnings  (month  PA)  there  is  little  indication  of  any 
significant  bias  for  the  healthy  -firms,  but  consistent  indication 
o-f  significant  bias  for  failing  firms.  Assuming  that  management 
discloses  "news"  throughout  the  year  that  is  used  by  analysts  to 
update  forecasts,  and  assuming  that  failing  firms  on  average  have 
more  "bad"  news  to  disclose  than  healthy  firms,  this  result  is 
consistent  with  implications  of  some  studies  (e.g.  Penman  C19801) 
that  firms  may  withhold  bad  news  as  long  as  possible  but  release 
good  news  earlier.  It  is  inconsistent  with  other  studies  (e.g. 
Ajinkya  and  Gift  C19841)  that  firms  have  equal  incentives  to 
release  good  and  bad  news.  Finally,  note  that  there  is  no 
indication  of  significant  systematic  error  for  either  group  in  year 
4,  suggesting  that  no  systematic  difference  exists  between  the  two 
groups  four  years  prior  to  bankruptcy. 

Of  course  Tables  B1-B4  only  test  for  the  existence  of  a 
systematic  forecast  error  within  each  group.  A  negative  bias  is 
present  for  both  groups  and,  in  spite  of  indications,  the  tables  do 
not  prove  that  there  is  a  significantly  greater  bias  for  the 
failing  firms.  Tables  B5-B6  provide  results  of  both  parametric 
tests  (t— tests)  and  non— parametric  (wilcoxon)  tests  for  differences 
in  average  forecast  error  between  the  two  groups.  The  findings 
support  the  conclusions  drawn  from  Tables  Bl— B4.  Average  forecast 
errors  Are  significantly  more  negative  for  failing  firms  during 
years  1-3.  Findings  are  stronger  using  the  wilcoxon  test, 
suggesting  that  individual   extreme   negative   values  are      not  the 
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TABLE  B5 
DIFFERENCE  IN  FORECAST  ERRORS  BETWEEN  GROUPS 
YEAR  1  YEAR  2 


AFE 


RFE 


PFE 


Month 
PA 
O 
3 
6 
9 
12 

PA 

O 
3 
6 
9 
12 

PA 

O 

3 

6 
9 
12 


T-TEST 
t      a 

-2.82  .009 

-3.38  .002 

-3.95  .001 

-4.51  .000 

-4.69  .000 

-4.64  .000 

-.25  .802 

-1.59  .115 

.03  .967 

.11  .915 

.30  .764 

.54  .590 

-3.08  .005 

-2.81  .009 

-3.64  .001 

-3.05  .006 

-3.08  .006 

-3.18  .004 


WILCOXON 

Z  a 

-4.42  .000 

-4.69  .000 

-5.53  .000 

-6.22  .000 

-6.29  .000 

-5.79  .000 

-3.27  .001 

-3.31  .001 

-3.54  .000 

-3.96  .000 

-3.83  .000 

-3.25  .001 

-4.44  .000 

-4.78  .000 

-5.78  .000 

-6.19  .000 

-6.33  .000 

-5.76  .000 


T-TEST 
t      a 

-1.32  .196 

-1.72  .093 

-2.77  .009 

-3.75  .001 

-2.94  .006 

-2.73  .011 

-2.13  .038 

-2.50  .016 

-2.02  .051 

-2.22  .034 

-2.74  .010 

-2.63  .014 

-2.29  .028 

-2.75  .009 

-3.69  .001 

-3.54  .001 

-3.31  .003 

-2.90  .007 


WILCOXON 

Z  a 

-2.54  .011 

-2.97  .003 

-4.06  .000 

-3.92  .000 

-3.18  .002 

-3.47  .001 

-2.81  .005 

-3.30  .001 

-4.47  .000 

-4.05  .000 

-3.62  .000 

-4.13  .000 

-2.69  .007 

-3.23  .001 

-4.42  .000 

-3.99  .000 

-3.60  .000 

-3.89  .000 
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TABLE  B6 

DIFFERENCE  IN  FORECAST  ERRORS  BETWEEN  GROUPS 


YEAR  3 


YEAR  4 


AFE 


RFE 


PFE 


T-TEST 

WILCOXON 

T-TEST 

WILCOXON 

Month 

t 

cc 

Z 

a 

t 

a 

Z 

a 

PA 

-2.26 

.029 

-1.95 

.051 

.49 

.624 

-.  14 

.890 

0 

-2.63 

.012 

-3.21 

.001 

.66 

.513 

.34 

.734 

3 

-2.25 

.031 

-2.84 

.005 

-1.02 

.314 

-.56 

.579 

6 

-2.21 

.035 

-2.47 

.016 

-1.87 

.072 

-.95 

.342 

9 

-1.99 

.056 

-2.  11 

.035 

-1.81 

.083 

-1.22 

.224 

12 

-2.01 

.056 

-2.07 

.039 

-1.87 

.078 

-1.05 

.292 

PA 

-1.  17 

.247 

-1.71 

.087 

-1.26 

.219 

-.38 

.707 

0 

-1.65 

.  104 

-3.00 

.003 

-1.26 

.219 

.29 

.766 

3 

-1.23 

.226 

-2.60 

.009 

-1.62 

.  118 

-.88 

.380 

6 

-1.  18 

.243 

-2.28 

.023 

-1.93 

.066 

-1.  12 

.264 

9 

-1.06 

.298 

-2.  11 

.034 

-1.98 

.058 

-1.39 

.  162 

12 

-.99 

.330 

-1.76 

.078 

-1.54 

.  139 

-.88 

.379 

PA 

-2.96 

.005 

-3.04 

.002 

.  13 

.897 

.06 

.956 

0 

-3.33 

.002 

-3.68 

.000 

.  10 

.919 

.41 

.678 

3 

-2.82 

.008 

-3.20 

.001 

-1.43 

.  160 

-.81 

.416 

6 

-2.82 

.008 

-2.94 

.003 

-1.69 

.  104 

.68 

.498 

9 

-2.48 

.019 

-2.69 

.007 

-1.66 

.  109 

-.97 

.  332 

12 

-2.37 

.026 

-2.46 

.014 

-1.54 

.  143 

-.69 

.491 
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cause  o-f   the  result.    No   difference  between  groups  is  evident  in 
year  4. 

5. 3. 2  Regression  Test  -  Full  Sample 

Theil  [19661,  Mincer  and  Zarnowitz  [196911  and  Givoly  [198511 
distinguish  between  two  kinds  o-f  bias.  Forecasts  may  contain  a 
"level"  bias  in  that  on  average  forecasts  are  too  low  or  too  high. 
The  previous  tests  suggest  some  level  bias  in  forecasts  for  failing 
firms.  It  is  possible,  however,  that  forecasts  may  be  unbiased  on 
average  but  still  exhibit  a  bias  that  is  conditional  on  the  nature 
of  earnings  -  e.g.,  forecasts  may  overstate  earnings  when  earnings 
are  high  and  understate  earnings  when  earnings  are  low.  This  is 
referred  to  as  a  "regression"  bias  and  could  occur  when  no  level 
bias  is  present.  This  suggests  an  alternative  approach  for 
assessing  bias. 

The  most   commonly  used   approach  is  to  estimate  a  regression 
of  the  following  form: 

Actual  =  fto  +  {lx  (Forecast)  +  e 
where  the  dependent  variable  is  actual  earnings  or  earnings  growth 
and  the  independent  variable  is  predicted  earnings  or  earnings 
growth.  The  regression  can  be  estimated  using  either  time  series 
data  for  individual  firms  or  cross-sectional  data  at  a  given  point 
in  time.  The  null  hypothesis  that  ft0  =  0  and  &x  -  1  is  tested,  and 
rejection  of  the  null  hypothesis  is  treated  as  evidence  of  bias. 
If  forecasts  are  on  balance  too  high  (too  low)  then  the  intercept 
term  ft0  would  be  less  than  (greater  than)  zero.   If  forecasts  are 
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too   high   (law)   when   earnings  are      high  and  too  law  (high)  when 
earnings  are    low  then   the   coefficient   term  (lx  would   be  less 

(greater)  than  one. 

Two  cross— sect ional  versions  o-f  the  above  regression  were 
estimated  using  unde-flated  EPS  measures  and  EPS  measures  de-flated 
by  stock  price.  Regressions  were  estimated  at  selected  months  -for 
-four  years  prior  to  failure  using  the  full  sample  of  firms  -  i.e., 
including  both  failing  and  healthy  firms.  Clearly  this  is  not  a 
representative  sample  as  it  is  much  more  highly  weighted  toward 
failing  firms  than  the  population  of  firms  in  general. 

Parameter  estimates,  F  statistics  and  significance  levels  for 
the  two  hypothesis  of  interest,  £0  =  0  and  &x  —  1,  are  presented  in 
Table  B7.  Findings  are  similar  for  both  deflated  and  undeflated 
tests.  In  years  1—3  the  two  null  hypotheses  can  be  rejected  at  .05 
or  better  for  a  majority  of  the  tests.  £0  is  universally  negative, 
which  is  consistent  with  the  level  bias  noted  in  previous  tests. 
fix  is  generally  greater  than  one.  This  is  consistent  with  a 
regression  bias  where  optimistic  forecasts  are  associated  with  low 
earnings  realizations  and/or  pessimistic  forecasts  are  associated 
•with  high  earnings  realizations.  (These  results  are  not  present  in 
year  four,  again  indicating  that  the  distinguishing  properties  of 
the  failing  firms  are  not  exhibited  four  years  prior  to 
bankruptcy. ) 
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3. 3. 5  Regression  Tests  -  By  Group 

Both  Givoly  C1985D  and  Cr  i  tch-f  ield,  Dyckman  and  Lakonishok 
C1978H  detected  no  substantial  level  or  regression  bias  in  their 
tests.  Although  their  sample  sizes  were  perhaps  more  representative 
o-f  the  population  o-f  all  -firms,  they  were  not  fully  representative 
in  that  -firms  with  poor  (i.e.,  negative)  earnings  were  deleted.  The 
earnings  for  the  failing  firms  a^re  lower  and  more  frequently 
negative  than  earnings  for  the  healthy  firms  in  the  current  study. 
(Both  t-tests  and  wilcoxon  tests  reveal  significantly  lower 
earnings,  at  a  =  .05,  for  the  failing  group  as  compared  to  the 
healthy  group  for  years  1-3.  No  significant  difference  exists  in 
year  4.)  It  is  probable  that  the  exhibited  bias  is  driven  by  the 
heavy  representation  of  failing  firms  in  the  sample.  To  explore 
the  issue  further,  a  modified  version  of  the  above  regression  was 
estimated  as  follows: 


Y  =  G,r0<F)  +  3mo(H>  +  ftrx  (F  x  Y)  +  /5hi  (H  x  Y)  +  e 


where 


F  =  1  if  firm  is  in  failing  group 
=  0  if  not 

H  =  1  if  firm  is  in  healthy  group 
=  0  if  not 


Y  =  actual  earnings 

A 

Y  =  forecasted  earnings 


(iFo  and  (jfi  s.r&    equivalent  to   fto   and  (l  %       for   a   regression  that 
includes  failing   firms  only;   likewise  for  ftMo  and  £mi  and  healthy 
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-firms.   Estimating  the  regression  jointly  including  failing  and 
healthy  -Firms  allows  -for  testing  six  hypotheses. 

a)  <Vo    =    0 

b)  Amo    =0 

C  )         (JF-O       =       (3  HO 

d)  Gn    =    1 

e)  Ami     =     1 
■f)      tff-1      =     (3hi 

Findings  -for  selected  months  for  the  four  years  prior  to  bankruptcy 
Are  included  in  Table  B8.  The  Table  include  intercepts, 
coefficients,  F  statistics  for  each  hypothesis,  and  significance 
levels. 

As  in  previous  tests,  results  for  years  1—3  are  most 
interesting.  Columns  3  and  5  of  the  Table  show  that  significant 
over-estimation  of  earnings  occurs  for  failing  firms  while  column  4 
indicates  no  similar  level  bias  for  healthy  firms.  Statistics 
indicating  a  regression  bias  ^re  also  occasionally  significant  (at 
.05)  for  failing  firms  (column  6)  but  never  significant  for  healthy 
firms  (column  7). 

It  seems  apparent  that  both  the  level  and  regression  bias 
detected  in  the  full  sample  regressions  results  in  Table  B7  a.re 
driven  by  the  presence  of  the  failing  firms.  Earnings  ^re  over- 
estimated for  the  failing  firms,  and  since  these  firms  tend  to  have 
poorer  earnings,  the  regression  bias  of  optimistic  forecasts 
associated  with  lower  earnings  results. 
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5. 4  Incorporation  of  Available  Information 

As  previously  noted,  systematic  error  captures  only  one 
aspect  o-f  rationality.  Rational  -forecasts  should  also  reflect  all 
relevant  historical  in-formation  available  at  the  time  o-f  -forecast, 
such  as  earnings  history,  past  -forecasts,  past  forecast  errors,  and 
stock  price  in-formation,  as  well  as  other  exogenous  in-formation. 
Given  unlimited  historical  in-formation,  it  is  not  -feasible  to  test 
-for  the  incorporation  of  all  relevant  historical  information  in 
forecasts.  Past  research  (Givoly  C1985D,  Fried  and  Givoly  C1982U, 
Malkiel  and  Cragg  C1980D)  has  instead  tested  whether  forecasts 
incorporate  two  more  obvious  kinds  of  available  information:  past 
earnings  series  and  past  forecast  errors.  The  findings  to  date  Are 
consistent  with  analysts  forecasts  reflecting  the  information  in 
both  past  earning  and  past  forecast  errors. 

3.4. 1  Past  Earnings 

It  is  also  not  feasible  to  test  if  forecasts  incorporate  all 
information  that  may  exist  in  the  time  series  of  past  earnings. 
There  ^re  too  many  possible  systematic  patterns  that  may  exist. 
The  test  conducted  here  instead  investigates  whether  forecasts 
incorporate  the  information  contained  in  three  naive  mechanical 
prediction  models  based  on  past  earnings.  The  models  used  were  as 
follows:   Fit-  =  YT_i 

F2T  =  YT_!  +  (Y.-,  -  Y,— 2) 

F3T  =  YT_ x  +  1/2   ((YT_X  -  YT-2)  +  <YT- 2  -  YT_3)) 

Where  F ; T   is  the  mechanical  forecast  from  model  1,  2,  or  3.   Model 
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1  is  a  martingale,  models  2  and  3  are  submartingales  which  di-f-Fer 
only  in  the  period  over  which  earnings  growth  is  calculated.  Past 
time  series  studies  (See  Bao,  Lewis,  Lin  and  Manegold  C 19833  -for  a 
review)  have  -found  submartingal e  "  models  to  -fairly  represent  the 
time  series  behavior  o-f  annual  earnings  and  to  perform  as  well  as 
other  mechanical  models  in  -forecasting  next  period  earnings.  Both 
Givoly  C1985D  and  Fried  and  Givoly  C19823  used  submarti ngale  models 
as  a  benchmark  -for  assessing  -forecaster  rationality. 

Following  Givoly  C1985U,  the  partial  correlation  between 
actual  earnings  and  the  mechanical  model  prediction,  given  the 
analysts  -forecast,  was  calculated.  This  partial  correlation 
measures  any  association  between  actual  earnings  and  the  mechanical 
-forecast  that  is  not  incorporated  in  the  analysts  -forecast.  A 
non— zero  partial  correlation  would  indicate  the  availability  o-f 
unused  ex trapol ati ve  information  in  the  mechanical  forecast. 
Partial  correlation  results  are  presented  in  Table  B-10. 
Correlations  between  actual  earnings  for  the  three  years  prior  to 
bankruptcy  with  the  mechanical  model  forecasts  for  that  year  (when 
data  availability  allowed),  while  controlling  for  analysts 
forecasts  available  at  various  times  (PA,  0,  3,  6,  9)  prior  to 
announcement,  as  well  as  cumulative  results  for  data  aggregated 
over  the  three  years,  are  presented.  Both  undeflated  and 
price-deflated  measures  of  actual,  mechanical  model,  and  analyst 
forecasts  were  used.  For  the  healthy  group  there  is  no  indication 
of  correlation  across  the  tests.  R3s  are  consistently  small  and 
insignificant,  and   it  is   safe  to  conclude  that  analysts  forecasts 
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incorporate   the   information   contained   in   the   three  mechanical 
model s. 

In  spite  o-F  some  indication  o-f  significant  negative 
correlations  among  the  results  for  the  undeflated  tests  for  the 
failing  firm  group,  the  evidence  is  not  consistent,  and  does 
disappear  when  aggregated  over  the  three  years.  It  is  difficult  to 
make  a  convincing  case  for  non— incorporation  of  past  earnings 
information  from  these  tests.  The  results  using  price-deflated 
measures  eire  strongly  significant  in  year  1,  with  a  similar  pattern 
evident  in  the  cumulative  tests.  The  very  high  positive 
correlations  (up  to  .95)  are  perhaps  too  strong  to  be  true. 
Undeflated  measures  that  exhibit  immaterial  correlation 
surprisingly  become  highly  correlated  when  deflated  by  a  common 
deflator.  It  would  appear  that  the  results  ^re  spurious  and  caused 
by  the  deflating  procedure. 

In  short,  there  is  no  convincing  evidence  of  any  consistent 
lack  of  incorporation  of  past  earnings  series  information  in 
forecasts  in  either  the  failing  or  healthy  groups;  and  there  is  no 
indication  of  any  pattern  in  the  data  that  may  be  exploited  to 
distinguish  between  failing  and  healthy  firms. 

3.4.2  Past  Forecast  Errors 


The  second  item  of  information  that  is  readily  available  to  a 
forecaster  and  should  be  considered  in  prediction  is  the  previous 
forecast  error.  If  a  forecaster  uses  past  forecast  error  informa- 
tion in  setting  future   forecasts   there   should   be   no  consistent 
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association  between  -forecast  errors  over  time — i.e.,  no  serial 
correlation.  Consistently  over-estimating  or  under-estimating 
earnings  (positive  serial  correlation)  or  consistent  mis-adjustment 
to  past  -forecast  errors  (e.g.  reacting  to  under-esti  mati  on  one 
period  with  over-estimation  the  next,  followed  by  under-estimati on 
again — i.e.,  negative  serial  correlation)  would  both  indicate  the 
presences  o-f  unexploited  information  in  the  series  o-f  past  -forecast 
errors. 

Ideally,  serial  correlation  should  be  tested  on  a  -firm  by 
-firm  basis,  since  a  consistent  pattern  o-f  mis-adjustment  could  be 
present  for  firms,  but  the  type  of  pattern  could  differ  from  firm 
to  firm.  Givoly  C19853  used  firm  specific  time  series  regressions 
of  the  (Actual  -  Forecast)^-  =  cc  +  (l  (Actual  -  Forecast )  ^-i  +  e 
to  test  for  serial  correlation  in  forecast  errors.  He  was  unable 
to  reject  the  null  hypothesis  that  oc  =  0,  {I  =  0,  and  concluded  a 
lack  of  serial  correlation  between  errors. 

There  is  insufficient  times  series  data  to  test  for  firm 
specific  serial  correlation  in  this  study.  Instead,  cross-secti- 
onal tests  are  conducted.  Correlations  between  year  t— 1  forecast 
errors  at  month  PA  and  year  t  forecast  errors  at  selected  months 
Are  contained  in  Tables  Bll  and  B12  for  undeflated,  relative,  and 
price-deflated  forecast  error  measures.  Individual  correlation 
statistics  are  significant,  but  no  consistent  pattern  is  apparent 
in  the  tables.  When  aggregated  over  the  three  years  available,  the 
cumulative  correlations  for  both  the  undeflated  (AFE)  and  relative 
(RFE)  measures  are    small  and  generally  insignificant.   Again,  there 
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TABLE  B-ll 

SERIAL  CORRELATION  BETWEEN  FORECAST  ERRORS  (Pearsons) 


YEARS 
1/2 


2/3 


;/4 


ALL 


Month 

PA 
O 

3 
6 
9 

PA 

0 

3 

6 

9 

PA 

O 

3 

6 

9 

PA 
0 
3 
6 

9 


FAILING 


HEALTHY 


AFE 


RFE 


29 

-.  11 

27 

-.  14 

43 

-.  15 

42 

-.01 

39 

-.00 

27 

.06 

26 

.03 

18 

.  10 

43* 

.  14 

67*** 

.  15 

01 

.  15 

01 

.  19 

38* 

.07 

35 

.07 

37 

.06 

18 

.  11 

17 

.  16 

23* 

.08 

17 

.09 

03 

.07 

PFE 

.62** 

.75*** 

.72*** 

.81*** 

.81*** 

-.  15 
-.  15 

.06 

.  15 

.30 

.  15 

.  11 
-.  16 
-.  15 
-.  17 

.51*** 
.60*** 
.57*** 
.66*** 
.68*** 


AFE 

.08 
.  11 
.09 

.  11 
.  11 

-.  14 
-.08 

.01 
-.01 

.26 

.  19 

.52*** 

.41** 

.33* 

.35* 

.01 
.  11 
.  12 
.  13 
.21** 


RFE 

.04 

.07 
.01 

.01 
.01 

-.  15 
-.  15 
-.  15 
-.06 
.  10 

.20 

.67*** 

.56*** 

.52*** 

.51*** 

-.02 
.04 
.00 
.04 
.05 


PFE 

.  12 
.  17 
.  15 
.  16 
.  14 

.06 
.06 
.15 
.15 
.28* 

.24 
.32* 
.33* 
.  33* 
.38* 

.  11 
.  16 
.  18* 
.  19* 
.29** 


Significance  Level:   .05*/  .01**/  .001*** 
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TABLE  B-12 

SERIAL  CORRELATION  BETWEEN  FORECAST  ERRORS  (Spearman) 


FAILING 


HEALTHY 


Years 
1/2 


2/: 


;/4 


ALL 


Month 

PA 
O 
3 
6 

9 

PA 

O 

3 

6 

9 

PA 

O 

3 

6 

9 

PA 
O 

~r 

6 
9 


AFE 

RFE 

PFE 

AFE 

RFE 

PFE 

-.37 

-.21 

-.03 

.  16 

.24 

.  18 

-.30 

-.  10 

-.02 

.27* 

.35** 

.33* 

-.46* 

-.  16 

-.  10 

.37** 

.42** 

.41** 

-.31 

.22 

-.03 

.40** 

.47*** 

.43** 

-.  17 

.26 

.  11 

.42** 

.46*** 

.44*** 

-.  10 

.  13 

-.  12 

.  11 

.  10 

.  17 

-.09 

.21 

-.  10 

.08 

.06 

.  16 

.02 

.37* 

.07 

.  16 

.  15 

.20 

.21 

.34 

.20 

.  17 

.23 

.20 

.33 

.40* 

.26 

.30* 

.36** 

.28* 

.  33 

.53** 

.34 

-.  18 

-.11 

-.01 

.22 

.37 

.22 

-.02 

.03 

.06 

.  16 

.  18 

.08 

-.06 

-.06 

.04 

.09 

.25 

.08 

-.07 

-.04 

.01 

.  13 

.33 

.  12 

.02 

.03 

.  12 

-.03 

.21 

.03 

.04 

.08 

.  12 

-.03 

.23* 

.03 

.  12 

.  16* 

.  19* 

.03 

.25* 

.  12 

.  17 

.21** 

.25** 

.09 

.30** 

.  17 

.  19* 

.25** 

.26** 

.  17 

.38*** 

.23* 

.28*** 

.31*** 

.31*** 

Signi-f icance  Level:  .05*/  .01**/  .001*** 
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are  some  large  correlations  using  price-deflated  measures,  but  they 
may  be  caused  by  the  de-flation  process.  Overall  there  is  little 
basis  to  argue  for  a  consistent  significant  serial  correlation 
among  errors. 

To  explore  the  issue  further,  the  signs  of  forecast  errors 
were  investigated.  Chi-square  tests  of  association  between  the 
sign  of  forecast  errors  in  successive  years  were  conducted  using 
month  PA  forecasts  from  the  earlier  year  and  forecasts  at  various 
months  (PA,  0,  3,  6,  9)  from  the  later  year.  Frequency  percentages 
(the  percent  of  sample  firms  falling  within  each  of  the  four 
possible  sign  combination  categories),  X2  values  and  significance 
levels  for  rejection  of  the  hypothesis  of  no  association  between 
successive  year  forecast  error  signs  are  in  Table  B— 13. 

Several  items  are  of  note.  First,  for  the  failing  firm 
group,  cell  sizes  a.re  frequently  too  small  for  valid  X3  tests. 
There  is  always  a  clear  majority  of  firms  that  have  negative 
forecast  errors  in  the  later  year,  regardless  of  which  pair  of 
successive  years  prior  to  bankruptcy  are  viewed.  In  other  words, 
there  are  more  negative  forecast  errors  (over-estimation  of  income) 
as  the  time  prior  to  bankruptcy  approaches.  There  is  a  strong 
tendency  for  negative  errors  to  be  followed  by  negative  errors 
(because  of  the  trend  of  increasing  frequency  of  negative  errors), 
but  there  is  no  corresponding  tendency  for  positive  errors  to  be 
followed  by  positive  errors  (again  because  of  the  trend  of  increas- 
ing negative  errors),  and  consequently  there  is  no  rejection  of  the 
null  hypothesis   of  no   association  between   successive  errors.   In 
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Years 


1/2 


2/; 


;/4 


ALL 


TABLE  B-13 

ASSOCIATION  BETWEEN  SIGNS  OF  SUCCESSIVE  FORECAST  ERRORS 


FAILING 

Frequency  Percentage 
(Sign  at  t/sign  at  t-1) 


HEALTHY 

Frequency    Percentage 
(Sign    at    t/sign    at    t-1) 


Month 

-/- 

-/  + 

+  /- 

+  /  + 

X2 

-/- 

-/  + 

+  /- 

+  /  + 

X2 

PA 

50 

-rtr 

10 

.07 

41 

24 

15 

20 

2.  15 

0 

50 

35 

10 

5 

.07 

44 

22 

11 

24 

6.  18 

* 

3 

58 

42 

0 

0 

44 

20 

11 

26 

7.64 

** 

6 

56 

44 

0 

0 

47 

20 

7 

25 

11.28 

*** 

9 

60 

40 

0 

0 

49 

19 

5 

27 

15.48 

*** 

PA 

48 

24 

21 

7 

.  19 

37 

19 

17 

28 

4.56 

* 

0 

48 

26 

19 

7 

.26 

37 

17 

17 

30 

5.87 

* 

63 

25 

6 

6 

.75 

40 

20 

15 

25 

4.89 

% 

6 

66 

3 

10 

4.07   * 

44 

20 

9 

26 

8.84 

*$ 

9 

61 

19 

10 

10 

1.58 

43 

22 

11 

24 

5.77 

* 

PA 

43 

25 

4 

29 

6.65   ** 

23 

39 

16 

2.00 

0 

36 

36 

11 

18 

.36 

28 

37 

19 

17 

.43 

3 

39 

14 

14 

.06 

26 

40 

21 

14 

1.69 

6 

37 

37 

11 

15 

.  11 

23 

40 

21 

17 

1.50 

9 

39 

36 

7 

18 

1.20 

29 

36 

16 

20 

.01 

PA 

47 

27 

12 

14 

2.01 

34 

26 

18 

1.93 

0 

44 

32 

14 

10 

.00 

37 

24 

15 

24 

6.52 

* 

3 

51 

34 

8 

8 

.39 

37 

25 

15 

22 

5.  19 

* 

6 

53 

32 

5 

9 

2.58 

39 

26 

12 

23 

9.81 

** 

9 

53 

30 

6 

10 

2.86 

41 

25 

10 

24 

14.42 

*** 

Singni-f  icance    Level:     .054/    .01**/    .001*** 
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short,  the  trend  toward  negative  errors  is  "interesting"  but  does 
not  provide  evidence  that  signs  of  errors  are  serially  associated. 

For  the  healthy  group  the  null  hypothesis  o-f  no  association 
can  be  rejected  in  most  o-f  the  tests  conducted.  Negative  errors 
tend  to  -Follow  negative  errors;  positive  tend  to  -follow  positive. 
This  is  surprising  and  conflicts  with  the  findings  in  Tables  B-ll 
and  B-12  using  correlations.  It  suggests  that  the  signs  of 
successive  forecast  errors  may  be  related  (and  be  reflected  in  the 
Chi-square  tests)  while  the  magnitude  of  the  forecast  errors,  given 
the  sign  ^re  not  related  (thus  reducing  the  earlier  correlations). 
This  suggests  there  may  be  some  serial  association  between  success- 
ive forecast  errors  that  were  not  revealed  in  the  correlation  tests 
conducted  by  Givoly  C1985!3.  Future  tests  investigating  just  the 
signs  of  forecast  errors  and  using  larger  samples  than  this  paper 
may  be  warranted. 

With  respect  to  the  various  tests  of  incorporation  of  past 
information  in  forecasts,  there  is  little  strong,  consistent, -and 
unambiguous  evidence  to  confidently  reject  the  hypothesis  that 
analysts  forecasts  reflect  information  available  in  past  earnings 
and  past  forecast  errors.  The  most  convincing  new  finding  was  that 
the  signs  of  successive  forecast  errors  may  be  related,  but  this 
finding  needs  additional  research.  Further,  while  some  differences 
between  failing  and  healthy  firms  were  evident  in  the  data,  there 
is  no  obvious  difference  that  appears  to  be  potentially  useful  in 
predicting  impending  bankruptcy. 
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3. 5  Accuracy  o-P  Analysts  Forecasts 

Past  investigations  o-f  the  Accuracy  o-f  analysts  forecasts 
(see  Givoly  and  Lakonishok  C 19843  -for  a  review)  have  generally 
■focused  on  two  questions:  Are  analysts  -forecasts  more  accurate 
than  -forecasts  from  mechanical  models?  And  how  do  analyst's 
forecasts  compare  to  management  forecasts?  Results  of  studies 
comparing  analysts  forecasts  with  forecasts  from  numerous  types  of 
mechanical  models  (e.g.  random  walk  model,  submartingal e  models, 
Box-Jenkins  models  exploiting  serial  correlation  in  the  earnings 
time  series,  and  index  models  tying  earnings  predictions  to  a 
market-wide  index  of  earnings)  have  occasionally  been  contra- 
dictory, but  in  general  analyst  forecasts  appear  to  out— perform 
mechanical  models.  Results  of  studies  comparing  analyst  forecasts 
to  management  forecasts  suggest  a  slight  but  insignificant  advan- 
tage to  management.  These  results  a.rs  not  surprising.  One  would 
expect  analysts  to  out— perform  mechanical  models  given  the  wider 
information  set  on  which  analysts  may  rely.  Likewise,  one  would 
not  be  surprised  by  the  essentially  similar  performance  between 
analysts  and  management  given  their  similar  information  sets  and 
the  incentives  for  management  to  provide  information  to  analysts 
(Lees  [19833,  Ajinkya  and  Gift  £198411). 

The  objective  in  this  section  is  to  test  for  systematic  diff- 
erences in  analyst  accuracy  between  failing  and  healthy  firms.  The 
two  most  popular  error   measures  in   past  studies   are  the  relative 


error 


Forecast  -  Actual  I  /  Actual 
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and  the  relative  squared  error 

(Forecast  -  Actual)2  /  Actual 
The  squared  error  gives  greater  weight  to  large  errors  which  is 
consistent  with  a  quadratic  loss  -function.  The  two  error  measures, 
however,  tend  to  be  highly  correlated.  Because  of  the  problems 
associated  with  deflating  by  actual  earnings  when  earnings  a.r& 
small  or  negative,  as  noted  in  the  earlier  discussion  of  bias 
measures,  four  different  error  measures  a.re    used  in  the  study: 

a)  Absolute  Error  Measure  (AEM) 
=  [Forecast  -  Actual! 

b)  Relative  Error  Measure  (REM) 

=  (Forecast  -  Actual]  /  I  Actual  | 

c)  Squared  Error  Measure  (SEM) 

=  (Forecast  -  Actual)2  /  (Actual | 

d)  Price-deflated  Error  Measure  (PEM) 

=  (Forecast  -  Actual |  /  Stock  price 
Each  error  measure  can  only  take  on  positive  values. 

3.5. 1  Failing  vs.  Healthy  Firms 

The  first  test  of  interest  is  whether  there  is  any  difference 
in  analyst  forecast  accuracy  for  failing  firms  and  healthy  firms. 
Larger  values  for  the  error  measures  imply  less  accurate  forecasts. 
Table  A-l  provides  mean  values  for  each  of  the  four  error  measures 
for  selected  months  prior  to  year-end  for  year  1.  Statistics  and 
probability  levels  for  both  t-tests  and  wilcoxon  tests  of  the  null 
hypothesis  of  no  difference  between  group  means  a.re    also  presented. 
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Tables  A-2  through  A— 4  provide  similar  in-f  ormati  on  -for  years  2-4. 

Findings  are  robust  across  the  -four  error  measures.  For  both 
failing  and  healthy  firms  errors  steadily  decrease  as  reporting 
date  is  approached.  This  is  consistent  with  the  finding  of  others 
(e.g.  Crichfield,  Dyckman,  Lakonishok  C1978D).  For  all  four  years, 
however,  the  hypothesis  of  no  difference  in  accuracy  can  be 
rejected.  Errors  are  consistently  larger  for  failing  firms.  Using 
wilcoxon  tests  the  difference  is  significant  at  .05  or  lower  for 
all  except  8  of  the  possible  80  year — month-error  measure  combina- 
tions. Seven  of  the  eight  non-significant  differences,  however, 
occur  in  year  4.  Observing  the  magnitude  of  Z  values  and  signifi- 
cance levels,  there  is  a  tendency  for  the  difference  in  accuracy  to 
be  more  pronounced  as  bankruptcy  is  approached.  Evidence  from  the 
t-tests,  although  not  quite  as  consistently  strong,  support  the 
same  conclusions:  less  accurate  forecasts  for  failing  firms,  and 
larger  errors  and  declining  comparative  accuracy  as  bankruptcy 
approaches.  The  findings  suggest  that  accuracy  of  forecasts  are 
one  possible  information  item  that  may  be  exploited  for  predicting 
impending  failure. 

3.5.2  Analysts  Forecasts  vs.  Naive  Models 

The  typical  approach  used  in  past  studies  to  assess  accuracy 
has  been  to  compare  analyst  accuracy  with  the  accuracy  achieved  by 
mechanical  models  based  on  past  earnings.  Do  analysts  forecast 
better  than  extrapolations  of  past  earnings?  Is  the  performance  of 
analysts  relative  to  mechanical  models  the  same  for   both  groups  of 
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TABLE  A  1 

DIFFERENCES  IN  ERROR  MEASURES  BETWEEN  GROUPS 


Error 


AEM 


REM 


REM 


SEM 


Month 

PA 

0 

3 

6 

9 

PA 
O 

3 
6 
9 

PA 

O 

3 

6 

9 

PA 

O 

3 

6 

9 


MEANS 

t- 

TEST 

WILCOXON 

Fai 1 ing 

Healthy 

t 

a 

z 

oc 

3.  65 

.39 

3.  16 

.004 

5.89 

.000 

4.  17 

.40 

3.  34 

.003 

5.97 

.000 

5.  16 

.55 

3.75 

.001 

5.46 

.000 

6.  63 

.72 

4.20 

.000 

5.95 

.000 

6.66 

.89 

4.31 

.000 

6.01 

.000 

1.00 

.54 

1.  13 

.266 

4.45 

.000 

.77 

.40 

2.54 

.013 

4.55 

.000 

.96 

1.06 

-.21 

.836 

3.71 

.000 

1.29 

1.50 

-.31 

.761 

3.96 

.000 

1.45 

1.85 

-.48 

.  635 

3.83 

.000 

.68 

.03 

4.  10 

.000 

6.61 

.000 

.79 

.04 

2.92 

.007 

6.52 

.000 

.94 

.05 

3.60 

.001 

6.07 

.000 

1.34 

.06 

2.99 

.007 

6.09 

.000 

1.47 

.07 

3.02 

.007 

6.24 

.000 

5.09 

.47 

2.  16 

.039 

5.33 

.000 

3.92 

.35 

2.99 

.006 

5 .  50 

.000 

5.27 

1.58 

2.43 

.019 

4.93 

.000 

7.43 

2.87 

2.  10 

.040 

5.40 

.000 

7.99 

4.35 

1 .  33 

.  188 

5.38 

.000 
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TABLE  A  2 

DIFFERENCES  IN  ERROR  MEASURES  BETWEEN  GROUPS 

YEAR  2 


MEANS 


t-TEST 


WILCOXON 


Error 


AEM 


REM 


REM 


SEM 


Month 


Failing   Healthy 


.38 
.43 
.58 
.63 
.75 


PA 

1.28 

0 

1.40 

3 

2.07 

6     " 

2.  10 

9 

2.97 

PA 

.61 

0 

.72 

3 

1.64 

6 

2.  18 

9 

2.23 

PA 

.  17 

0 

.23 

3 

.39 

6 

.43 

9 

.55 

PA 

1.00 

0 

1.29 

3 

3.05 

6 

4.48 

9 

6.21 
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TABLE  A  3 

DIFFERENCES  IN  ERROR  MEASURES  BETWEEN  GROUPS 

YEAR  3 


Error 


AEM 


REM 


PEM 


SEM 


Month 

PA 

0 

3 

6 

9 

PA 

O 

3 

6 

9 

PA 

0 

3 

6 

9 

PA 

O 

3 

6 

9 


MEANS 

t- 

TEST 

WILCOXON 

Failing   H 

eal thy 

t 

a 

Z 

a 

.71 

.32 

2.31 

.026 

2.61 

.009 

.86 

.34 

2.78 

.008 

3.76 

.000 

1.52 

.44 

2.24 

.032 

3.39 

.001 

1.89 

.64 

1.94 

.062 

2.54 

.011 

2.59 

.77 

1.85 

.074 

2.  18 

.029 

1.  15 

.49 

1.41 

.  166 

3.40 

.017 

1.33 

.49 

1.66 

.  104 

3.37 

.001 

2.49 

.65 

1.23 

.226 

3.38 

.001 

2.85 

.92 

1.  13 

.266 

2.  14 

.032 

3.54 

1.  15 

1.02 

.319 

1.88 

.060 

.08 

.02 

3.  06 

.004 

3.04 

.002 

.  10 

.02 

3.66 

.001 

4.07 

.000 

.  14 

.03 

3.01 

.005 

3.99 

.000 

.  16 

.04 

2.54 

.017 

2.94 

.003 

.21 

.05 

2.25 

.  033 

2.38 

.017 

1.09 

.42 

1.59 

.  117 

2.64 

.008 

1.46 

.76 

.98 

.329 

3.68 

.002 

4.07 

1.  12 

1.28 

.207 

3 .  56 

.000 

4.96 

2.08 

1.04 

.306 

2.40 

.016 

8.35 

3.27 

1.02 

.316 

2.09 

.036 
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TABLE  A  4 
DIFFERENCES  IN  ERROR  MEASURES  BETWEEN  GROUPS 

YEAR  4 


Error 


AEM 


REM 


PEM 


SEM 


Month 

PA 

0 
3 
6 
9 

PA 
O 

6 
9 

PA 
O 

6 
9 

PA 

0 

3 

6 

9 


MEANS 

t- 

TEST 

WILCOXON 

Failing   H 

=al thy 

t 

a 

z 

oc 

.57 

.27 

1.67 

.  104 

1.84 

.065 

.62 

.26 

1.73 

.092 

2.59 

.010 

.91 

.39 

2.  15 

.039 

1.72 

.085 

1.70 

.  56 

2.  13 

.044 

2.42 

.016 

2.21 

.77 

1.98 

.060 

1.50 

.  134 

.80 

.  16 

1.47 

.  152 

2.27 

.023 

.92 

.  16 

1.53 

.  137 

2.46 

.014 

1.06 

.28 

1.65 

.  Ill 

1.83 

.066 

1.45 

.  36 

2.05 

.051 

2.45 

.014 

1.59 

.48 

2.04 

.052 

1.61 

.  107 

.05 

.02 

2.05 

.049 

2.97 

.003 

.05 

.02 

2.04 

.050 

2.79 

.  005 

.06 

.03 

2.51 

.017 

2.34 

.019 

.09 

.04 

2.  10 

.046 

2.35 

.019 

.  12 

.05 

1.95 

.064 

1.52 

.  128 

.76 

.  13 

1.75 

.090 

2.30 

.  02  1 

.85 

.  14 

1.76 

.090 

.011 

1.30 

.24 

2.  15 

.040 

1.98 

.048 

4.47 

.52 

1.64 

.  114 

2.84 

.005 

7.79 

.76 

1.40 

.  177 

1.87 

.062 
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■firms?  Givoly  and  Lakonishok  C19S4U  say  that  i -f  -Forecasts  are 
rational  they  should  be  the  most  accurate  -forecasts.  This  suggests 
that  no  mechanical  model  should  out-perform  analysts.  Thus  a 
comparison  o-f  analyst  accuracy  with  mechanical  model  accuracy  could 
have  implications  -for  the  rationality  o-f  analysts  forecasts. 

Tests  were  conducted  in  both  the  -failing  and  healthy  groups 
to  compare  analysts  with  a  naive  no— change  model  that  predicted 
next  period  earnings  as  equal  to  last  period  earnings.  Thus 
earnings  arB  -forecasted  by  model  Fl  as  presented  in  section  3.4.1. 
(Analogous  tests  were  conducted  using  models  F2  and  F3,  where  data 
permitted.  Findings  using  models  F2  and  F3  are  not  reported  here 
but  airs    consistent  with  the  -findings  using  model  Fl). 

The  procedure  used  was  as  follows.  For  each  year  the  four 
error  measures  (AEM,  REM,  PEM,  SEM)  were  determined  using  the 
previous  years  earnings  as  the  forecast.  Differences  in  forecast 
errors  between  analysts  and  the  naive  prediction  were  determined  by 
subtracting  the  naive  prediction  error  measure  from  the  corres- 
ponding analyst  forecast  error  measure.  The  mean  error  differences 
would  be  zero  if  analysts  and  the  naive  model  were  equally  accur- 
ate, negative  if  analysts  were  more  accurate,  and  positive  if  the 
naive  model  was  more  accurate.  T-tests  of  the  null  hypothesis  that 
the  mean  error  difference  is  zero,  using  error  differences  from  the 
four  error  measures  (AEM,  REM,  PEM,  SEM)  Are  summarized  in  Table 
A-5. 

A  fifth  variable  was  also  determined  as  an  alternative 
approach  to  comparing  accuracy.   A  log  relative  error  measure  (LEM) 
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was  determined  as  follows 

LEM  =     In  /'Actual  -  Analyst  forecast^ 
^Actual  -  Naive  -forecast   / 

This  measure  will   also   equal   zero   when   analysts   are   equal  in 

accuracy  to   the  naive   prediction  and   be  negative  (positive)  when 

analysts  are    more  (less)  accurate.   T-tests  -for  the  null  hypothesis 

that  LEM  equal  zero  are    also  contained  in  Table  A-5. 

Findings  for  healthy  firms  are  quite  consistent  across  the 
three  years  and  selected  months  reported  in  Table  A-5.  Signs  are 
almost  universally  negative,  suggesting  analysts  are  more  accurate 
than  the  naive  prediction.  The  mean  error  differences  grow  in 
absolute  magnitude  as  the  reporting  date  approaches  indicating  that 
relative  accuracy  improves.  By  three  months  prior  to  the  end  of 
the  report  year  one  can  reject  the  null  hypothesis  of  equal  analyst 
vs.  naive  model  forecast  accuracy  (at  .05  or  better)  across  most  of 
the  five  error  measures  in  the  three  year  period  presented.  As  the 
report  date  approaches,  the  superiority  of  the  analysts  over  the 
naive  model  becomes  stronger. 

The  picture  is  not  as  clear  for  the  failing  firms.  In  year 
1,  signs  are  as  often  positive  as  negative.  In  no  case  can  the 
null  hypothesis  be  rejected.  It  is  apparent  that  when  failure  is 
near,  analysts  have  no  advantage  over  a  naive  no-change  model  in 
forecasting  actual  earnings.  Year  2  findings  are  quite  different. 
Error  difference  signs  are  predominately  negative,  and  signifi- 
cantly negative  by  month  0.  Thus  by  the  end  of  the  reporting  year 
analysts  out-perform  the  Naive  forecast. 
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Surprisingly,  error  di  -f  f  erences  in  year  3,  though  predominan- 
tly negative,  ^re  not  significant.  One  might  expect  the  poor 
analyst  performance  in  year  1  just  prior  to  failure;  there  would 
likely  be  considerable  uncertainty  concerning  earnings.  The  lack 
of  statistically  significant  analyst  superiority  over  the  naive 
model  in  year  3  indicates  that  the  difficulty  in  out-performing  the 
naive  prediction  is  not  limited  to  the  year  immediately  prior  to 
failure.  •  Greater  uncertainty  associated  with  failing  firms  may 
prevent  analysts  from  out— performing  the  naive  prediction  even  when 
failure  is  not  immediately  imminent. 

One  can  compare  error  differences  between  the  failing  and 
healthy  groups  using  t-tests  and  Uilcoxon.  Comparison  of  AEM,  REM, 
REM,  SEM  error  differences  are  not  fully  valid.  If  one  assumes 
greater  uncertainty  in  the  failing  firm  group,  then  errors  for  both 
analysts  and  the  naive  model  should  be  larger  and  the  error 
difference  measures  may  be  correspondingly  larger,  even  though  the 
relative  superiority  (inferiority)  of  analysts  compared  to  the 
naive  model  is  the  same  as  in  the  healthy  group.  The  only  fair 
comparison  is  using  LEM,  because  the  magnitude  of  the  analyst  error 
is  deflated  by  the  naive  model  error.  Tests  involving  LEM  (not 
reported)  show  LEM  to  be  significantly  higher  (more  positive  or 
less  negative)  for  failing  firms  in  year  1.  No  significant 
difference  occurs  in  years  2  or  3. 

3.6  Dispersion  of  Rorecasts 

Previous    research    has    investigated    the   variation   or 
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dispersion  across  analysts  forecasts  as  a  measure  or  indication  of 
uncertainty.  Cukierman  and  Givoly  C19823  present  a  model  in  which 
the  dispersion  o-f  -forecasts  across  -forecasters  is  positively 
associated  with  the  dispersion  o-f  the  distribution  o-f  expected 
earnings  and  there-fore  with  the  cross-sectional  error  in  forecasts. 
Empirical  evidence  supported  their  model;  measures  of  dispersion 
were  positively  associated  with  measures  of  forecast  error. 
Results  from  Elton,  Gruber  and  Gultekin  C19843  also  document  this 
relationship.  Cukierman  and  Givoly  argue  that  the  cross-sectional 
error  in  earnings  is  the  empirical  counterpart  of  uncertainty. 
Dispersion  of  earnings  forecasts  have  also  been  found  to  be 
associated  with  traditional  risk  measures  such  as  beta,  the 
standard  deviation  of  returns  and  earnings  growth  variability 
(Givoly  and  Lakonishok  C 19833.) 

The  purpose  of  this  section  is  to  determine  if  measures  of 
dispersion-  in  forecasts  differ  systematically  between  failing  and 
healthy  firms  as  bankruptcy  approaches,  with  the  purpose  of 
identifying  dispersion  related  measures  that  may  be  useful  in 
distinguishing  failing  from  healthy  firms.  The  implicit  assumption 
is  that  forecast  dispersion  measures  may  reflect  risk  that  is 
ultimately  manifested  in  bankruptcy. 

3.6. 1  Dispersion  Measures 

For  each  company  for  each  month,  IBES  provides  information  on 
the  high  estimate  among  the  individual  analysts  forecasts  avail- 
able,  the    low   estimate,   and   the   standard   deviation   of   the 
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estimates.  Use  o-f  the  standard  deviation  as  a  measure  of  disper- 
sion is  -frequent  in  other  studies(e.g.  Crich-field,  Dyckman  and 
Lakonishok  C19783).  Others  (e.g.,  Castanias  and  Griffin  L1984D) 
suggest  that  it  is  not  entirely  appropriate  to  combine  standard 
deviations  cross-secti  onal  1  y  and  suggest  the  use  o-f  alternative 
measures  o-f  dispersion.  Tests  were  conducted  using  the  seven 
di-f-ferent  dispersion  measures  to  follow.  Only  observations  where 
the  number  o-f  -forecasts  per  -firm  was  greater  than  or  equal  to  two 
were  included.  Findings  Are  remarkably  similar  across  the  measures 
making  the  choice  of  measure  somewhat  moot.  Test  results  for  a 
representative  selection  of  the  seven  measures  Are  reported.  The 
seven  measures  of  dispersion  a.re 

1.  The  standard  deviation  (STh4D)  of  earnings  forecasts  across 
analysts  for  individual  firms  at  a  particular  month.  This  measure 
is  given  by  IBES. 

2.  The  variance  (VAR) ,  calculated  by  squaring  the  STND. 

3.  The  natural  log  of  the  variance  (LVAR) ,  designed  to  reduce 
potentially  undesirable  effects  of  not  scaling  the  data  for  firm 
size. 

4.  The  coefficient  of  variation  (CVAR) ,  calculated  by  deflating 
the  STND  by  the  absolute  value  of  the  mean  forecast,  again  an 
attempt  to  deflate. 

5.  The  price  deflated  variance  (PVAR) ,  determined  by  dividing  the 
variance  by  stock  price  in  the  corresponding  month,  an  alternative 
deflating  approach. 

6.  The  range   (RNG) ,  determined   by  the  high  and  low  forecasts  in 
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any  given  month  on  IBES. 

7.   The  price-de-f  lated   range  (PRNG)  ,   dividing  the   range  by  stock 

price  to  adjust  -for  size  e-f-fects. 

3.6.2  Dispersion  Tests 

Both  parametric  (t-tests)  and  non— parametr i c  (Wilcoxon)  tests 
were  conducted  to  determine  if  the  dispersion  o-f  analysts  -Forecasts 
-for  -failing  -firms  was  systematically  different  than  for  healthy 
firms.  Given  the  previous  research  suggesting  that  forecast 
dispersion  captures  uncertainty,  one  would  hypothesize  greater 
dispersion  for  failing  firms  than  healthy  firms  and  increasing 
dispersion  as  bankruptcy  approaches. 

Findings  from  t— tests  were  consistent  with  findings  from  the 
wilcoxon  tests.  Results  from  the  wilcoxon  tests  for  three  repre- 
sentative measures,  the  standard  deviation,  the  price-deflated 
variance  and  the  range,  appear  in  Table  Dl.  (Note  that  because 
wilcoxon  tests  ^re  based  on  ranks,  results  using  the  STND,  VAR  and 
LVAR  ^re    identical). 

The  findings  reported  in  Table  Dl  Are  not  dependent  on  the 
specific  dispersion  measure.  In  year  one,  failing  firms  have 
significantly  (oc  1  .05)  greater  dispersion  across  analysts  for  a 
full  year  prior  to  fiscal  year  end.  There  is  consistent  indication 
that  uncertainty  as  reflected  in  -forecast  dispersion  is  associated 
with  impending  failure.  There  is  also  a  steady  increase  in  the 
-failing  group  average  STND,  PVAR  and  RNG  as  the  earnings  announce- 
ment  date   approaches.   Thus   there   is   also  some  indication  that 
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uncertainty  increases  as  the  year  end  (and  thus  bankruptcy) 
approaches. 

In  contrast,  in  year  -four  there  is  no  indication  o-f  a 
difference  in  dispersion  for  any  of  the  three  measures  at  any  of 
the  months.  Uncertainty  associated  with  future  failure  is  not 
reflected  in  significantly  less  agreement  by  analysts  in  earnings 
predictions.  One  year  closer  to  failure,  in  year  three,  the  first 
indications  of  wider  dispersion  for  failing  firms  shows  up; 
significantly  larger  dispersion  measures  a.re  found  for  failing 
firms  in  months  zero  and  15.  Another  year  closer  to  failure,  year 
two,  provides  more  convincing  evidence; 

significantly  larger  dispersion  measures  a.r&  found  for  failing 
firms  starting  about  six  months  prior  to  year  end  and  continuing 
through  the  earnings  announcement. 

In  short,  dispersions  measures  may  reflect  uncertainty  or 
risk  associated  with  impending  failure  and  may  contain  information 
useful  for  distinguishing  between  healthy  and  failing  firms.  The 
results  suggest  that  significant  differences  in  forecast  disper- 
sions start  appearing  and  continue  to  exist  from  about  18  months 
prior  to  the  end  of  the  last  fiscal  year  before  to  the  failure 
year,  although  hints  of  greater  dispersion  for  failing  firms  may  be 
evident  even  before  that  period. 

3.7  Revisions  in  Forecasts 

Research  on  revisions  in  earnings  forecasts  by  analysts  is 
limited.    Past  investigations   have  attempted   to  characterize  the 
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-forecast  -formation  process  by  observing  the  relationship  between 
forecast  revisions  and  information  hypothesized  to  motivate 
revision.  Studies  by  Brown  and  Rozeff  C19793,  Abdel-Khalik  and 
Espejo  C 19783  and  Givoly  C 19853  provide  evidence  that  forecasters 
adapt  their  predictions  in  a  manner  consistent  with  the  information 
contained  in  successive  quarterly  or  annual  earnings  releases, 
lowering  (raising)  predictions  when  past  earnings  were  over- 
predicted  (under-predicted).  Both  Givoly  and  Lakonishok  C19793  and 
Brown,  Foster  and  Noreen  1 19853  provide  evidence  for  a  small  but 
apparent  positive  dependence  over  time  in  the  direction  (up  or 
down)  of  mean  forecast  revisions.  Brown,  Foster  and  Noreen  suggest 
this  may  happen  either  because  analysts  3Lre  "spreading"  their 
revision  over  separate  successive  months  or  because  separate 
analysts  do  not  adjust  simultaneously  to  the  same  information. 
There  does  not  appear  to  be  any  strong  clustering  of  forecast 
revisions  around  the  time  of  interim  or  annual  earnings  releases, 
and  revisions,  up  or  down,  tend  to  be  similar  in  frequency;  there 
is  however  some  tendency  for  a  greater  frequency  of  revisions 
within  the  twelve  months  immediately  prior  to  an  annual  earnings 
release  when  compared  to  the  period  18  —  24  months  prior  to  release 
(Brown,  Foster  and  Noreen). 

Our  concern  here  is  whether  forecast  revision  behavior  may 
differ  systematically  between  failing  and  healthy  firms  such  that 
measures  related  to  revisions  may  indicate  future  failure.  One 
might  suggest  various  possibilities.  First,  greater  uncertainty 
associated   with   failing   firms   may  be  reflected  in  more  frequent 
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revisions.  On  the  other  hand,  a  tendency  -for  bad  news  to  be 
withheld  by  management  may  result  in  less  in-formation  being 
released  -for  -failing  -firms  and  consequently  less  frequent  revi- 
sions. Second,  poor  performance  associated  with  impending  -failure 
should  lead  to  more  -frequent  downward  earnings  revisions  and 
perhaps  less  -frequent  upward  revisions.  Third,  i-f  in  fact  bad  news 
is  delayed  by  failing  firms  in  the  hopes  of  a  cure  or  turn  around, 
there  may  be  a  tendency  for  bad  news  and  therefore  downward 
revisions  to  cluster  toward  year  end  or  just  prior  to  release  of 
the  actual  earnings  figure. 

3.7.1  Revision  Measures 


Three  different  measures  of  the  frequency  of  analyst  forecast 
revisions  were  determined.  A  measure  of  the  frequency  of  total 
revisions  (up  and  down)  per  month  was  calculated  by  dividing  the 
total  number  of  revisions  in  a  given  month  by  the  number  of 
analysts  estimates  that  were  available  in  that  month.  These 
monthly  percentage  figures  were  averaged  over  multi— month  periods 
to  smooth  out  the  measures.  Frequency  of  revision  measures  were 
averaged  over  the  following  three  month  periods:  months  0-2,  3  — 
5,  6  —  8,  9  —  11;  the  following  six  month  periods:  0—5  and  6  - 
11;  the  full  year  prior  to  year  end:  0  -  11;  and  over  the  3  months 
immediately  prior  to  the  release  of  the  actual  figure:  designated 
PA-PA3.  Measures  of  the  frequency  of  downward  revisions  and 
upward  revisions  were  determined  in  an  analogous  manner,  using  the 
number  of  downward  or    upward  revisions  individually. 
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3.7.2  Revision  Tests 

Both  t-tests  and  wilcoxon  tests  -for  differences  in  group 
means  between  failing  and  healthy  firms  were  conducted  for  the 
three  types  of  revision  measures  averaged  across  the  indicated 
periods  in  the  four  years  prior  to  bankruptcy.  Results  from 
t-tests  and  wilcoxon  tests  were  the  same;  however,  wilcoxon  tests 
rest  on  less  restrictive  distributional  assumptions.  Table  Rl 
contains  group  means,  wilcoxon  test  Z  scores  and  probability  levels 
for  rejection  of  the  null  hypothesis  of  no  difference  between 
groups.  The  majority  of  the  test  statistics  are  insignificant  at 
traditional  alpha  levels  (i.e.,  .05  or  lower)  but  several  tests  are 
significant  and  some  regularities  exist  in  the  table. 

For  both  groups,  down  revisions  are  much  more  frequent  than 
up  revisions.  Down  revisions  tend  to  be  at  least  four  times  more 
frequent  regardless  of  what  time  period  revision  measures  are 
averaged  over.  Since  forecast  accuracy  tends  to  improve  as  year  end 
approaches  (i.e.,  as  information  arrives  to  forecasters  and  they 
update)  the  dominance  of  downward  revisions  indicates  over  optimis- 
tic forecasts  occur  early  and  are    corrected  as  year  end  approaches. 

The  preponderance  of  negative  Z  values  for  the  tests  invol- 
ving upward  revisions  is  consistent  with  more  frequent  upward 
revisions  for  healthy  firms;  however,  only  three  of  the  Z  values 
are    significant  for  the  various  periods  reported  in  the  table. 

All  except  three  Z  values  are  positive  for  the  downward 
revision  tests,  and  about  a  third  of  the  Z  statistics  are  sign- 
ificant. Thus  there  is  consistent,  frequently  significant,  evidence 
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that  failing  -firms  have  a  higher  -frequency  o-f  downward  revisions. 
There  is  also  an  indication  that  downward  revisions  as  a  percentage 
o-f  total  estimates  a.re  more  -frequent  in  the  0  -  5  month  period 
rather  than  in  the  earlier  6-11  month  period,  and  a  tendency  -for 
larger  and  more  significant  Z  values  to  be  associated  with  the  0  - 
5  month  period  (except  in  year  4).  This  suggests  an  increase  in 
downward  adjustments,  particularly  for  failing  firms,  as  year  end 
approaches. 

The  pattern  of  measures,  signs  and  size  of  Z  statistics,  and 
significance  levels  for  the  all  (both  up  and  down)  revisions  column 
in  the  table  a.re  very  similar  to  the  downward  revisions  column. 
Analysts  make  more  forecast  revisions  in  general  for  failing  firms, 
and  the  frequency  of  revisions  appear  greater  toward  year  end.  But 
given  that  downward  revisions  a.re  far  more  frequent  than  upward 
ones  in  the  sample,  the  results  for  the  all  revisions  tests  seem  to 
be  driven  by  the  more  frequent  downward  revisions  for  the  failing 
firm  group. 

To  summarize,  there  s.re  more  frequent  downward  revisions  for 
failing  firms  appearing  in  all  four  years  prior  to  bankruptcy,  and 
a  tendency  for  the  frequency  to  be  greater  in  the  last  six  months 
of  each  year.  However,  there  is  no  particular  individual  three 
month,  six  month  or  12  month  period  in  which  the  frequency  of 
downward  revisions  is  significantly  greater  for  failing  firms  in 
even  three  out  of  the  four  years  tested.  Thus  there  is  no  partic- 
ular individual  revision  measure  that  emerges  as  one  that  might 
consistently  help  to  distinguish  failing  from  healthy  firms. 
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3.8  Mean  Forecast  Values 

One  obvious  place  to  look  for  differences  between  failing  and 
healthy  firms  is  simply  in  the  level  of  future  earnings  predicted 
for  firms  in  each  group.  Although  low  earnings  does  not  imply 
bankruptcy  and  high  earnings  does  not  insure  health,  one  would 
expect  some  relationship  between  the  level  of  earnings  and  the 
probability  of  future  failure.  While  reported  earnings  may  contain 
information  relevant  to  distinguishing  between  groups,  forecasted 
earnings  Are  future  looking  and  consequently  have  the  potential  of 
reflecting  aspects  of  firm  health  that  have  not  yet  been  reflected 
in  reported  earnings. 

Mean  forecasted  earnings  (the  average  across  analysts)  was 
used  to  determine  if  there  were  significant  differences  between 
failing  and  healthy  firm  groups.  Two  measures  were  investigated: 
the  undeflated  mean  forecasted  earnings  per  share  and  the  mean 
forecasted  earnings  per  share  deflated  by  stock  price  to  adjust  for 
size  differences.  Both  parametric  (t— tests)  and  non— parametr i c 
(Wilcoxon)  tests  for  group  differences  were  conducted.  Results  for 
both  t-tests  and  Wilcoxon  tests  applied  to  both  undeflated  and 
deflated  measures  of  earnings  provided  similar  findings,  hence  only 
the  results  of  the  Wilcoxon  tests  on  undeflated  measures  ar& 
reported.  Table  ME  1  provides  the  average  mean  forecasted  earnings 
per  share  for  both  failing  and  healthy  firm  groups  at  3  month 
intervals  within  each  year  for  the  four  year  period  prior  to 
bankruptcy. 

Several   findings  Are       of   note:     First,   there  is  a  clear 
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TABLE   ME    1 
6ROCP   DIFFEROCSS    IN  MEAN  FORECASTS 


AVERAGE  FORECAST 

YEAR                MONTH  FAIHN8  HEATHY 

1                        PA  -1.30  1.53  -5.43  -OOO 

O  -.86  1.57  -6.17  -OOO 

3  -.27  1.77  -6.15  .000 

6  .44  1.95  -4.91  .OOO 

9  .88  2.02  -4.23  .OOO 

12  1.11  2.13  -3.88  .OOO 


PA  -.97  1.67  -5.01  .COO 

O  -.81  1.69  -4.94  .OOO 

3  .07  1.87  -4.25  .OOO 

6  .58  2.10  -3.36  .001 


-1.30 

1.55 
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1.57 

-.27 

1.77 
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1.95 

.88 

2.02 

1.11 

2.13 

-.97 

1.67 

-.81 

1.69 

.07 

1.87 
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2.10 

1.24 

2.14 

1.59 

2.23 

.18 

1.77 

.22 

1.91 

.95 

1.97 

1.24 

2.07 

1.78 

2.20 

2.16 

2.28 

1.16 

1.92 

1.11 

1.96 

1.59 

1.97 

2.09 

1.93 

2.33 

1.82 

2.85 

1.74 

9  1.24  2.14  -2.99  .003 

12  1.59  2.23  -1.87  .061 

PA  .18  1.77  -3.22  .OOl 

O  .22  1.91  -3.14  .002 

3  .95  1.97  -1.97  .049 

6  1.24  2.07  -1.62  .105 

9  1.78  2.20  -1.06  .291 

12  2.16  2.28  .20  .839 

PA  1.16  1.92  -1.67  .093 

O  1.11  1.96  -1.78  .075 

3  1.59  1.97  -.89  .373 

6  2.09  1.93  -.09  .924 

9  2.33  1.82  .21  .835 

12  2.85  1.74  1.74  .082 
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deterioration  o-f  the  level  o-f  earnings  -forecasted  -for  failing  -firms 
across  the  years  as  bankruptcy  approaches.  Second  there  is  a 
deterioration  o-f  earnings  within  each  -forecast  year  as  the  year  end 
approaches.  This  holds  -for  both  -failing  and  healthy  groups  (except 
in  year  4  for  the  healthy  firms).  Generally  the  within  year 
deterioration  for  failing  firms  appears  more  severe.  (Explicit 
tests  of  within  year  changes  follow  in  a  later  section.)  Third, 
there  ^re  significant  group  differences  in  the  level  of  forecast 
earnings  evident  in  all  years  except  year  4.  Looking  at  Z  values 
and  significance  levels,  the  differences  become  more  pronounced  as 
year-end  approaches  within  each  year  and  as  the  year  of  bankruptcy 
approaches.  None  of  these  findings  is  surprising;  if  information 
relevant  to  impending  failure  is  reflected  in  earnings  forecasts, 
and  their  change  over  time,  one  would  expect  more  significant 
differences  as  the  time  remaining  prior  to  failure  decreases.  The 
finding  do  however  suggest  some  potential  ability  of  measures  of 
mean  forecasted  earnings  to  distinguish  between  the  groups. 

3.9  Intra— year  Changes 

The  previous  sections  in  this  chapter  have  reported  on 
different  properties  of  forecasts  (bias,  incorporation  of  informa- 
tion, accuracy,  dispersion,  frequency  of  revision  and  mean  forecast 
level)  as  captured  by  various  measures  at  particular  points  in  time 
(or,  in  the  case  of  revision  measures,  averages  over  short  periods 
of  time).  The  questions  asked  were  whether  particular  properties 
differed  between  failing  and  healthy  firms.    This   section  expands 
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the  analysis  by  addressing  the  question  o-f  whether  changes  in 
particular  measures  within  a  given  forecast  year  differ  between 
groups. 

Past  research  has  provided  evidence  on  two  types  o-f  changes 
that  may  occur  within  a  given  -forecast  year.  One  consistent 
-finding  is  that  -forecasts  become  more  accurate  as  the  time  to  the 
announcement  o-f  actual  earnings  decreases  (e.g.,  Elton,  Gruber  and 
Gultekin  C19843).  A  viewing  o-f  the  error  measures  reported  in 
Tables  A-l  and  A— 2  suggest  this  result  holds  -for  -firms  in  the 
present  sample  also.  A  second  finding  concerns  agreement  among 
analysts  -forecasts.  Brown,  Foster  and  Noreen  C1985D  -find  that 
dispersion  o-f  -forecasts  across  analysts  decreases  systematically  as 
announcement  date  approaches.  Crich-field,  Dyckman  and  Lakonishok 
C197S]  and  Elton,  Gruber,  and  Gultekin  £198411  both  find  hints  of  a 
decrease  in  dispersion  but  not  convincing  evidence. 

Four  questions  related  to   intra— year  changes   were  investi- 
gated in  the  present  study: 

a.  Do  forecast  errors  decrease  as  the  time  remaining  to 
announcement  decreases? 
Given  the  strong  results  from  previous  studies  one  would  expect 
increasing  accuracy  as  the  announcement  date  approaches  for  both 
failing  and  healthy  firms.  This  is  expected  since  more  and  better 
information  becomes  available  to  estimate  as  the  period  progresses. 
Forecast  errors,  however,  a.r&  associated  with  risk  and  uncertainty. 
For  the  failing  firm  group,  the  passage  of  time  also  implies  the 
approach  of  bankruptcy.    One   might   hypothesize   that  approaching 
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bankruptcy  will  result  in  a  relatively  smaller  increase  in  -forecast 
accuracy  (less  decrease  in  -forecast  error)  for  -failing  -firms.  On 
the  other  hand,  -forecasts  -for  failing  firms  are  less  accurate. 
Thus  there  is  more  room  for  "improvement"  as  new  information 
arrives  throughout  the  year.  The  larger  forecast  errors  for 
failing  firms  may  allow  for  greater  improvement  and  thus  greater 
decrease  in  forecast  errors.  These  two  arguments  suggest  competing 
reasons  for  systematic  group  differences  in  changes  in  forecast 
accuracy  as  the  announcement  date  approaches. 

b.  Does  dispersion   among  forecasters  decrease  as  the  time 
remaining  to  announcement  decreases? 

Again,  the  expectations  are  that  dispersion  across  forecasters 
should  decrease  as  year  end  approaches,  but  because  dispersion 
measures  are  also  indicators  of  risk  and  uncertainty,  approaching 
bankruptcy  may  result  in  a  relatively  smaller  decrease  in  disper- 
sion for  the  failing  firms  group. 

c.  Does  the  frequency  of  revisions  in   forecasts  change  as 
the  time  remaining  to  announcement  decreases? 

Revisions  in  forecasts  for  both  failing  and  healthy  firms  should 
occur  as  relevant  information  becomes  available.  Firms  may  have 
incentives  to  withhold  bad  news,  and  failing  firms  may  have 
relatively  more  bad  news  to  withhold.  Consequently,  there  may  be  a 
tendency  for  delayed  information  release  by  failing  firms  and 
perhaps  more  revision  behavior  by  analysts  as  year  end  approaches. 
One  might  hypothesize  both  a  higher  relative  frequency  of  forecast 
revisions,  and  particularly  a  higher  relative  frequency  of  downward 
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revisions  as  year-end  approaches  -for  -failing  -firms. 

d.  Do  mean  -forecasts  decrease  as  the  time  remaining  to 
announcement  decreases? 
I-f,  as  research  -findings  suggest,  forecasts  a,re  both  somewhat 
optimistic  and  distinctly  more  accurate  as  announcement  approaches, 
then  both  -failing  and  healthy  firms  may  experience  a  trend  toward 
lower  forecast  earnings  estimates  as  the  year  end  approaches. 
Assuming  more  negative  information  becomes  available  for  failing 
firms,  one  would  expect  larger  and  more  negative  forecast  revisions 
(i.e.,  changes  in  mean  forecast  estimates)  for  failing  firms. 

In  short,  the  above  questions  ask  if  there  a.re  significant 
intra— year  changes  in  a)  forecast  errors,  b)  forecast  dispersion, 
c)  frequency  of  forecast  revisions,  and  d)  mean  forecasts. 

3.9.1  Measures  for  Intra— year  changes 

Four  measures  of  forecast  error  (absolute,  relative,  price- 
deflated,  squared),  seven  measures  of  forecast  dispersion  (standard 
deviation,  variance,  log  variance,  coefficient  of  variation,  price- 
deflated  variance,  range,  pr i ce— def 1 ated  range),  three  measures  of 
frequency  of  forecast  revisions  (up,  down,  total),  and  two  measures 
of  the  level  of  mean  forecasts  (undeflated  and  price-deflated)  were 
previously  explained. 

For  each  of  the  above  variables,  measures  of  the  change 
between  values  of  the  variables  determined  at  different  months 
within  each  forecast  year  were  determined.  Changes  between  monthly 
values  were  determined  for  the  following  pairs  of  months. 
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Later  Earlier 

Month  Month 

PA  0 

PA  3 

PA  6 

PA  9 

0  3 

0  6 

0  9 

3  6 

3  9 

h  9 

(For  the  -frequency  o-f  revision  measures,  averages  over  the  three 
months  ending  in  the  month  listed  above  were  used  rather  than  the 
point  estimates  at_  the  months  listed  above). 

For  each  of  the  variables  o-f  interest,  three  measures  o-f  the 
change  in  the  variable  between  the  two  monthly  values  were  compu- 
ted: 

1.  Absolute  change  =  (VL  -  VE) 

2.  Relative  change  =  (VL  -  VE)  /  |VE| 

3.  Log  relative  Change  =  In  (VL/VE) 

Where  VL  equals  the  value  o-f  the  variable  at  the  later  month 
and  VE  equals  the  value  o-f  the  variable  at  the  earlier  month. 

The  log  relative  measure  is  preferable  because  it  adjusts  for 
the  relative  size  of  the  variables  and  captures  only  the  relative 
change  in  magnitude.  It  also  is  symmetric  for  increases  and 
decreases  and  reduces  outlier  effects.  Unfortunately,  the  log 
relative  is  undefined  for  zero  or  negative  values  of  the  arguments, 
which  causes  substantial  sample  size  reduction. 

The  relative  change  measure  also  has  merit  because  it 
deflates   the   difference   in   values   across   time   for  magnitude. 
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However,  it  is  undefined  in  some  cases,  and  small  or  negative 
values  o-f  the  arguments  may  cause  a  misleading-  indication  o-F  the 
change  that  has  occurred. 

The  simple  absolute  difference  measure  can  be  criticized  for 
not  adjusting  for  the  absolute  magnitudes  of  the  measures,  however 
it  is  defined  for  all  values.  Furthermore  many  of  the  variables 
for  which  changes  SLr&  to  be  determined  have  already  been  deflated 
for  size  effects. 

3.9.2  Tests  of  Intra— year  Changes 

Two  kinds  of  questions  were  addressed.  First  t-test  were 
conducted  to  test  the  null  hypothesis  that  the  change  measures 
equaled  zero.  These  tests  were  conducted  separately  for  failing 
and  healthy  firms.  Second,  Wilcoxon  tests  were  conducted  to 
determine  if  change  measures  were  different  for  the  failing  and 
healthy  groups.  All  tests  were  conducted  for  each  of  the  four 
years  prior  to  bankruptcy.  The  t-tests  of  no  significant  differ- 
ence from  zero  a.re  of  secondary  interest.  The  between  group  tests, 
however,  relate  directly  to  contrasts  between  failing  and  healthy 
firms  in  intra-year  changes  and  consequently  have  potential 
relevance  in  identifying  measures  that  may  be  useful  for  distin- 
guishing between  the  groups. 

Findings  using  change  measures  2  and   3  (the   relative  change 
and  log  relative  change)  can  be  summarized  as  follows:  As  expected, 
changes  in  forecast  errors   were   consistently   significantly   (a  < 
.05)   negative   indicating   increasing  accuracy  as  the  announcement 
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date  approaches.  Changes  in  the  -frequency  o-f  revisions  (up,  down, 
and  total)  were  generally  positive  and  -frequently  signi  -f  icant , 
indicating  more  -frequent  revisions  in  analysts  -forecasts  as 
announcement  approaches.  Changes  in  dispersion  measures  were  not 
consistent  in  sign  and  were  only  occasionally  significant,  but 
hinted  at  a  decrease  in  dispersion  as  announcement  approaches. 
These  -findings  were  present  within  both  groups  o-f  -firms.  However, 
-for  tests  of  differences  in  intra— year  changes  in  forecast  errors, 
forecast  dispersion,  and  frequency  of  forecast  revisions  between 
failing  and  healthy  firms,  across  all  versions  of  measures,  across 
all  four  years,  results  were  consistently  insignificant. 

In  short,  test  results  using  measures  2  and  3  indicated  that 
accuracy  and  frequency  of  forecast  revision  increase,  and  disper- 
sion perhaps  decreases,  as  year  end  approaches,  but  these  observa- 
tions tend  to  hold  for  both  failing  and  healthy  firms.  There  was 
no  significant  systematic  group  difference  in  intra— year  changes  in 
errors,  dispersion  or  revision  frequency  measures  indicated  by  the 
tests,  and  consequently  no  specific  measures  were  identified  that 
could  prove  useful  in  distinguishing  between  the  two  groups  of 
firms.  Because  of  this  and  because  the  number  of  tests  conducted 
were  extensive,  no  tabular  results  using  measures  2  and  3  ^rs 
reported  here.  (Test  results  using  change  measures  2  and  3  to 
measure  intra— year  changes  in  the  level  of  mean  forecast  were  not 
valuable  because  of  the  large  number  of  negative  forecasts  values 
in  the  failing  firm  group.) 

Our   remaining   interest   is   then   with  results  using  change 
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measure  1,  the  absolute  di f f erence  in  variables  between   two  months 
with  the  year.   Some  tests  provided  results  worth  mention: 

1.  Findings  (relating  to  question  d  above)  concerning 
intra-year  changes  in  mean  -forecasts  aro  interesting.  Table  CI 
shows  results  for  the  -four  year  period.  Several  observations  are 
o-f  note.  First,  mean  values  o-f  the  change  measures  a.r&  consis- 
tently negative  in  sign  -for  -failing  -firms  -for  the  full  -four-year 
test  period.  Most  all  o-f  the  t  values  are  significant  except  in 
year  four.  This  provides  strong  evidence  of  optimistic  forecasts 
that  are  subsequently  and  consistently  revised  downward  as  each 
year  end,  and  bankruptcy,  approaches.  Second,  there  are  also 
consistently  significant  negative  changes  in  years  1  and  2  for  the 
healthy  firms.  This  is  not  surprising.  Forecasts  in  general  could 
be  optimistic  and  require  downward  revisions  if  general  economic 
conditions  were  deteriorating.  The  fact  that  years  1  and  2  reflect 
times  just  prior  to  bankruptcy  for  the  failing  firms,  coupled  with 
the  fact  that  bankruptcies  increase  in  frequency  during  periods  of 
overall  economic  stagnation,  is  consistent  with  those  years 
reflecting  periods  of  optimistic  forecasts  even  for  the  healthy 
firm  group.  Third,  and  most  important,  despite  downward  revisions 
for  both  groups,  the  magnitude  of  the  changes  in  mean  forecasted 
earnings  are  substantially  greater  for  the  failing  group.  Wilcoxon 
Z  values  a.re  universally  negative  over  the  four  years,  universally 
significant  in  years  1  and  2,  and  frequently  significant  in  years  3 
and  4.  In  short,  intra— year  changes  in  mean  forecasts  apparently 
provide  possible  measures  for  distinguishing  the  groups. 
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TABLE  C  1 

INTRA-YEAR  CHANGES  IN  MEAN  FORECASTS  - 
(Absolute  difference  in  unde-flated  mean  -forecasted  earnings) 


FAILING 

HEALTHY 

WILCOXON 

MONTHS 

MEAN 

t 

. 

MEAN 

t 

(X 

~z. 

P/0 

-.71 

-2.51 

.017 

-.06 

-2.41 

.019 

-2.87 

.0 

P/3 

-1.60 

-3.66 

.001 

-.24 

-3.52 

.001 

-3.95 

.0 

P/6 

-2.47 

-4.55 

.000 

-.36 

-3.67 

.001 

-4.70 

.0 

P/9 

-2.80 

-4.98 

.000 

-.45 

-3.59 

.001 

-4.86 

.0 

0/3 

-.72 

-3.27 

.002 

-.19 

-3.31 

.002 

-2.99 

.0 

0/6 

-1.34 

-4.36 

.000 

-.29 

-3.40 

.001 

-3.75 

.0 

0/9 

-1.89 

-4.68 

.000 

-.38 

-3.31 

.002 

-4.54 

.0 

3/6 

-.52 

-4.39 

.000 

-.  11 

-2.62 

.011 

-2.28 

.0 

3/9 

-1.09 

-3.80 

.001 

-.21 

-2.81 

.007 

-3.72 

.0 

6/9 

-.43 

-1.77 

.085 

-.09 

-2.40 

.019 

-2.11 

.0 

P/0 

-.31 

-3.98 

.000 

-.02 

-.61 

.544 

-3.19 

.0 

P/3 

-1.03 

-5.  15 

.000 

-.  19 

-3.07 

.003 

-4.72 

.0 

P/6 

-1.58 

-5.12 

.000 

-.29 

-4.20 

.000 

-4.32 

.0 

P/9 

-2.39 

-3.52 

.001 

-.36 

-3.21 

.002 

-4.02 

.0 

0/3 

-.89 

-3.81 

.000 

-.17 

-2.82 

.006 

-3.71 

.0 

0/6 

-1.51 

-4.  12 

.000 

-.27 

-3.95 

.000 

-3.66 

.0 

0/9 

-2.28 

-3.44 

.001 

-.35 

-3.29 

.002 

-3.46 

.0 

3/6 

-.58 

-4.05 

.000 

-.09 

-1.24 

.221 

-3.49 

.0 

3/9 

-1.26 

-2.98 

.005 

-.  16 

-1.47 

.  147 

-2.83 

.0 

6/9 

-.66 

-2.  10 

.041 

-.07 

-1.00 

.323 

-2.66 

.0 

P/0 

-.  12 

-3.32 

.002 

-.07 

-1.91 

.062 

-1.26 

.2 

P/3 

-.75 

-2.26 

.011 

-.  11 

-1.79 

.079 

-2.15 

.c 

P/6 

-1.  16 

-2.90 

.006 

-.14 

-1.27 

.211 

-2.85 

.c 

P/9 

-1.66 

-2.36 

.225 

-.24 

-1.55 

.  128 

-2.27 

.c 

0/3 

-.64 

-2.23 

.031 

-.03 

-.78 

.437 

-1.20 

r> 

0/6 

-1.05 

-2.65 

.012 

-.08 

-.89 

.378 

-2.26 

.c 

0/9 

-1.54 

-2.  18 

.036 

-.  18 

-1.35 

.  183 

-1.81 

.c 

3/6 

-.38 

-3.79 

.001 

-.05 

-.77 

.445 

-3.01 

.c 

3/9 

-.89 

-2.35 

.025 

-.  16 

-1.34 

.  187 

-2.07 

.c 

6/9 

-.54 

-1.78 

.085 

-.  11 

-1.75 

.086 

-.25 

.1 

P/0 

.03 

.86 

.394 

.01 

.59 

.556 

-1.  16 

.1 

P/3 

-.37 

-2.  10 

.044 

.02 

.25 

.806 

-2.  15 

.c 

P/6 

-.81 

-1.86 

.075 

.09 

.96 

.342 

-1.56 

.1 

P/9 

-1.07 

-1.61 

.121 

.19 

1.34 

.  189 

-1.  15 

.  1 

0/3 

-.45 

-2.65 

.012 

.01 

.25 

.807 

-2.48 

-C 

0/6 

-.93 

-2.22 

.035 

.09 

.98 

.334 

-1.78 

.c 

0/9 

-1.  15 

-1.69 

.  104 

.  19 

1.35 

.  185 

-1.27 

3/6 

-.44 

-1.81 

.081 

.07 

1.  10 

.277 

-1.52 

.  1 
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2.  Findings  (relating  to  question  a  above)  concerning  intra- 
year  changes-  in  -forecast  error  measures  are  also  interesting. 
Absolute  within-year  changes  were  determined  -for  each  of  the  -four 
-Forecast  error  measures  (unde-flated  errorf  relative  error,  price 
deflated  error,  and  squared  error).  Overall  findings  were  similar 
for  changes  based  on  each  of  the  four  error  measures.  Table  C2 
shows  representative  results  using  the  undeflated  forecast  error. 
Two  items  ^re  of  note:  First,  change  measure  Are  almost  universally 
negative  indicating  smaller  forecast  errors  as  year-end  approaches; 
this  was  expected.  Second,  the  reduction  in  forecast  error  is 
consistently  greater  for  failing  firms  in  years  1-3  and  significan- 
tly so  in  years  1  and  2.  This  is  probably  caused  by  the  overall 
larger  forecast  errors  for  the  failing  firms;  there  is  more  room 
for  improvement  as  new  information  arrives  during  the  forecast 
year.  These  larger  reductions  in  forecast  error  provide  a  poten- 
tial basis  for  discriminating  failing  from  healthy  firms. 

3.  Findings  (relating  to  question  b  above)  concerning  intra— 
year  changes  in  dispersion  measures  Are  less  clear  cut.  Absolute 
within  year  changes  were  determined  for  each  of  the  seven  disper- 
sion measures.  Findings  for  individual  statistics  were  not 
completely  consistent  across  the  tests  involving  the  seven 
measures,  but  the  overall  pattern  of  results  was.  Table  C3  shows 
representative  results  using  the  standard  deviation  across  fore- 
casts as  the  measure  of  dispersion.  The  results  Are  not  in  general 
significant,  but  an  interesting  pattern  is  evident  nevertheless. 
Changes  for  failing  firms  Are    positive  in  year  1  and  2  and  for  most 
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TABLE  C  2 

INTRA-YEAR  CHANGES  IN  FORECAST  ERRORS 
(Absolute  difference  in  undeflated   forecast  Error) 


FAILING 

HEALTHY 

WILCOXOIs 

YEAR  MONTHS 

MEAN 

t 

oc 

MEAN 

t 

a 

2 

0 

1      P/0 

-.31 

-.89 

.382 

-.01 

-.37 

.710 

-1.47 

.1 

P/3 

-1.  16 

-2.03 

.054 

-.  15 

-2.57 

.012 

-2.74 

.C 

P/6 

-2.  15 

-3.02 

.007 

-.34 

-4.45 

.000 

-3.87 

.C 

P/9 

-2.38 

-3.38 

.003 

-.52 

-5.05 

.000 

-3.69 

.C 

0/3 

-.87 

-2.  10 

.047 

-.  15 

-2.31 

.024 

-.79 

.4 

0/6 

-1.81 

-3.28 

.004 

-.33 

-4.06 

.000 

-2.94 

.C 

0/9 

-2.01 

3.65 

.002 

-.50 

-4.78 

.000 

-3.37 

.C 

3/6 

-.77 

-3.68 

.002 

-.  18 

-4.70 

.000 

-2.67 

.c 

3/9 

-1.05 

-4.39 

.000 

-.35 

-5.43 

.000 

-2.86 

.c 

6/9 

-.  18 

-1.  15 

.264 

-.  17 

-4.55 

.000 

-.32 

.7 

2     P/0 

-.12 

-2.78 

.009 

-.05 

-1.87 

.067 

-.91 

m2 

P/3 

-.81 

-3.  14 

.003 

-.20 

-3.52 

.001 

-3.67 

•  C 

P/6 

-1.21 

-3.49 

.002 

-.25 

-4.18 

.000 

-2.81 

.C 

P/9 

-2.  11 

-2.70 

.012 

-.36 

-4.01 

.000 

-2.63 

.c 

0/3 

-.64 

-2.76 

.009 

-.  15 

-2.64 

.011 

-3.11 

.c 

0/6 

-1.01 

-3.21 

.003 

-.  19 

-3.35 

.002 

-2.48 

.c 

0/9 

-1.86 

-2.56 

.016 

-.30 

-3.64 

.001 

-2.54 

.c 

3/6 

-.43 

-4.35 

.000 

-.03 

-.63 

.528 

-3.48 

.c 

3/9 

-1.30 

-2.46 

.019 

-.  14 

-1.75 

.086 

-2.75 

.c 

6/9 

-.87 

-1.90 

.067 

-.  11 

-1.64 

.  106 

-1.98 

■c 

3     P/0 

-.  10 

-2.67 

.012 

-.04 

-.94 

.349 

-1.61 

.1 

P/3 

-.77 

-2.16 

.039 

-.  12 

-2.  15 

.036 

-2.32 

.( 

P/6 

-1.  16 

-2.34 

.027 

-.29 

-2.72 

.009 

-1.23 

.  A 

P/9 

-1.91 

-2.28 

.031 

-.42 

-2.97 

.005 

-1.73 

.( 

0/3 

-.66 

-1.85 

.074 

-.09 

-2.74 

.009 

-1.21 

.1 

0/6 

-1.08 

-2.  15 

.040 

-.29 

-3.33 

.002 

-.81 

.< 

0/9 

-1.84 

-2.  18 

.038 

-.43 

-3.57 

.002 

-1.29 

.1 

3/6 

-.34 

-2.57 

.016 

-.  18 

-2.92 

.005 

-.29 

.7 

3/9 

-1.06 

-2.38 

.024 

-.32 

-2.93 

.005 

-1.41 

.1 

6/9 

-.71 

-1.94 

.063 

-.  14 

-2.37 

.022 

-1.42 

•1 

4     P/0 

.01 

.53 

.599 

.00 

.00 

1.000 

.55 

-5 

P/3 

-.28 

-1.40 

.  173 

-.  13 

-2.95 

.005 

.79 

.' 

P/6 

-.84 

-1.57 

.  129 

-.31 

-4.  12 

.000 

.47 

.1 

P/9 

-1.35 

-1.84 

.079 

-.51 

-4.86 

.000 

.79 

.t 

0/3 

-.29 

-1.47 

.  153 

-.12 

-3.31 

.002 

1.00 

B  % 

0/6 

-.85 

-1.60 

.  124 

-.28 

-4.08 

.000 

.09 

m  c 

0/9 

-1.43 

-1.87 

.076 

-.48 

-4.59 

.000 

.61 

c 

■  v 

3/6 

-.50 

-1.61 

.  121 

-.  16 

-2.70 

.010 

-.39 

.1 

3/9 

-1.05 

-1.98 

.062 

-.37 

-3.97 

.000 

-.  14 

A 

6/9 

-.49 

-2.07 

.051 

-.19 

-2.93 

.006 

.34 

- 
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TABLE  C  3 

INTRA-YEAR  CHANGES  IN  DISPERSION 

(Absolute  difference  in  Standard  deviation 

o-f  -forecasts  across  forecasters) 


FAILING 

HEALTHY 

WILCOXON 

ONTHS 

MEAN 

t 

a 

MEAN 

t 

ot 

~r 

oc 

P/0 

.73 

1.  14 

.274 

.02 

.53 

.600 

.92 

.354 

P/3 

.84 

1.06 

.307 

.01 

.23 

.819 

-.28 

.783 

P/6 

.95 

1.14 

.273 

-.00 

-.05 

.962 

-1.05 

.292 

P/9 

1.05 

1.25 

.230 

.02 

.32 

.753 

-.  16 

.874 

0/3 

.09 

.99 

.331 

.00 

.12 

.902 

-.44 

.662 

0/6 

.22 

1.50 

.  147 

-.03 

-.90 

.375 

.31 

.757 

0/9 

.28 

1.78 

.087 

-.00 

-.06 

.951 

.82 

.414 

3/6 

.05 

.62 

.539 

-.03 

-1.04 

.303 

.  15 

.878 

3/9 

.  10 

.95 

.351 

-.00 

-.05 

.962 

1.12 

.260 

6/9 

.06 

1.00 

.325 

.01 

.47 

.643 

1.03 

.299 

P/0 

.08 

.55 

.585 

-.05 

-2.12 

.038 

-.30 

.761 

P/3 

.  13 

.85 

.401 

-.08 

-3.13 

.002 

.90 

.368 

P/6 

.25 

1.62 

.116 

-.09 

-2.66 

.011 

1.51 

.  129 

P/9 

.29 

1.42 

.  168 

-.15 

-3.17 

.003 

1.12 

.261 

0/3 

.25 

1.00 

.324 

-.05 

-1.88 

.066 

.34 

.731 

0/6 

.42 

1.39 

.  175 

-.04 

-1.13 

.265 

1.78 

.074 

0/9 

.49 

1.28 

.211 

-.  10 

-2.70 

.009 

1.81 

.069 

3/6 

.12 

1.71 

.097 

.01 

.25 

.805 

2.11 

.034 

3/9 

.  13 

1.25 

.224 

-.04 

-1.17 

.248 

1.35 

.  175 

6/9 

.00 

.08 

.933 

-.06 

-2.26 

.028 

1.21 

.228 

P/0 

-.07 

-2.32 

.028 

-.06 

-1.40 

.  168 

-1.96 

.050 

P/3 

-.07 

-1.60 

.  122 

-.07 

-1.83 

.074 

-.49 

.620 

P/6 

-.02 

-.27 

.791 

-.  14 

-1.92 

.062 

.26 

.789 

P/9 

.02 

.31 

.757 

-.08 

-2.04 

.048 

1.32 

.186 

0/3 

.01 

.31 

.758 

-.01 

-.61 

.542 

.95 

.337 

0/6 

.05 

1.04 

.311 

-.08 

-1.34 

.  189 

1.16 

.244 

0/9 

.09 

1.69 

.  107 

-.05 

-.91 

.371 

2.54 

.011 

3/6 

.02 

.50 

.621 

-.06 

-1.31 

.  197 

.01 

.993 

3/9 

.06 

1.05 

.306 

-.03 

-.78 

.442 

1.48 

.  136 

6/9 

.03 

.91 

.376 

.04 

.88 

.385 

.57 

.567 

P/0 

-.04 

-1.00 

.329 

-.01 

-.81 

.420 

-.57 

.566 

P/3 

-.06 

-.32 

.749 

-.03 

-2.11 

.043 

.39 

.693 

P/6 

-.03 

-.19 

.855 

-.  11 

-2.58 

.014 

.44 

.656 

P/9 

.01 

.07 

.948 

-.07 

-1.88 

.070 

.55 

.579 

0/3 

-.02 

-.  12 

.902 

-.01 

-.36 

.717 

.76 

.447 

0/6 

-.03 

-.  16 

.871 

-.08 

-2.  13 

.040 

.23 

.815 

0/9 

.06 

.44 

.665 

-.07 

-1.66 

.  107 

.79 

.427 

3/6 

.04 

.48 

.639 

-.07 

-1.80 

.081 

.03 

.972 

3/9 

-.  11 

-2.25 

.042 

-.01 

-.28 

.780 

-1.94 

.051 

6/9 

-.03 

-1.  18 

.259 

.06 

1.88 

.070 

-1.  17 

.241 
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measures  in  year  3,  while  changes  -For  healthy  -firms  tend  to  be 
negative.  Thus  in  general  dispersion  across  -forecasters  tends  to 
increase  during  the  year  -for  -failing  -firms  and  decrease  -for  healthy 
firms.  This  is  what  one  would  expect  i -f  there  is  greater  unpre- 
dictability -for  -failing  -firms  due  to  uncertainties  associated  with 
future  bankruptcy. 

4.  Findings  (relating  to  question  c  above)  concerning  intra- 
year  changes  in  the  frequency  of  forecast  revisions  were  incon- 
clusive. For  intra— year  changes  in  the  three  measures  (up  revi- 
sions, down  revisions,  total  revisions)  there  were  no  systematic 
or  consistent  patterns  of  findings  or  significance  in  the  tests. 
No  tables  Are    presented. 

In  summary,  the  tests  conducted  in  this  section,  when  using 
the  absolute  change  measure,  provide  strong  evidence  of  systematic 
groups  differences  in  intra-year  changes  in  the  level  of  mean 
earnings  forecasts,  weaker  evidence  of  group  differences  in  intra- 
year  changes  in  forecast  errors,  suggestive  evidence  of  group 
differences  in  intra-year  changes  in  forecast  dispersion,  and  no 
evidence  of  group  differences  in  intra-year  changes  in  revision 
measures. 

3. 10  Inter— year  Trends 

The  previous  section  reported  on  tests  of  whether  forecast 
errors,  forecast  dispersion,  forecast  revisions,  or  the  level  of 
forecasts  changed  systematically  within  a  given  forecast  year. 
This   section   addresses   the   question   of   whether   properties  of 
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analysts  -forecasts  (forecast  error,  bias,  dispersion,  level  and 
revisions)  differ  -from  year  to  year,  and  more  importantly  whether 
year  to  year  trends  di-f-fer  between  -failing  and  healthy  firms. 

Five  year-to-year  trend  questions   were  investigated   for  the 
two  groups  of  sample  firms. 

a.  Does  the  magnitude  of  forecast  errors  change  from  year  to 
year?  One  would  hypothesize  increasing  forecast  errors  as 
bankruptcy  approaches  for  failing  firms  due  to  increasing 
uncertai  nty . 

b.  Does  the  degree  of  bias  in  forecasts  change  from  year  to 
year?  One  would  hypothesize  a  more  negative  bias  (over- 
optimistic  forecasts)  as  bankruptcy  approaches  for  failing 
firms.  This  might  be  expected  because  of  the  negative  bias 
for  failing  firms  previously  noted  in  section  3.3,  and  might 
be  explained  by  the  withholding  of  bad  news  information  by 
f ai 1 i  ng  f  i  rms. 

c.  Does  the  magnitude  of  forecast  dispersion  change  from  year  to 
year?  One  would  hypothesize  increasing  dispersion  for 
failing  firms  as  bankruptcy  approaches  due  to  greater  risk 
and  uncertainty. 

d.  Does  the  frequency  of  forecast  revisions  change  from  year  to 
year?  If  information  is  disclosed  one  would  expect  increasing 
frequency  of  downward  revisions  for  failing  firms  as  bank- 
ruptcy approaches.  There  is  no  reason  to  expect  any  partic- 
ular pattern  of  year  to  year  changes  for  healthy  firms. 

e.  Does  the   mean  level   of  forecasted  earnings  change  from  year 
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to   year?   One   would   expect   -forecasted   earnings   for  both 
-failing  and    healthy  -firms  to  reflect  year  to  year  trends  in 
both  economy  wide  and   industry   wide   conditions,   and  hence 
expect  some   year  to  year  trends  that  a.re    similar  between  the 
two  groups.   If  in  addition,  forecasted  earnings   for  failing 
firms  reflect   the  conditions   that  ultimately   lead  to  bank- 
ruptcy, failing  firms  may  show  more  of  a  year  to  year  decline 
than  healthy  firms. 
Ultimately  for   all  five  properties  the  question  of  interest  is  not 
whether  there  Are    systematic  year  to  year  trends  for  failing  firms, 
but  whether   those  trends  a.re    significantly  different  from  year  to 
year  trends  experienced  by  healthy  firms. 

Year  to  year  trends  in  errors,  bias,  dispersion,  level,  and 
revision  measures  were  determined  by  computing  the  year  to  year 
difference  for  particular  measures 

Difference  =  (Measure  -t  —  Measure  ^  — i) 
And  the  log  relative 

Log  Relative  =  (Measure  ^/Measure  t— 1) 
Error,,  bias,  dispersion  and  level  measures  were  previously  deter- 
mined at  three— month  intervals  prior  to  year  end,  within  each  of 
four  years  prior  to  bankruptcy  (i.e.,  at  the  last  month  of  each 
quarter,  months  0,3,6,  and  9,  as  well  as  at  the  month  just  prior  to 
announcement  of  actual  earnings).  The  year  to  year  trend  variables 
were  computed  for  each  measure  within  each  forecast  year  using  the 
corresponding  measure  from  the  same  month  in  the  previous  year, 
(e.g.,  differences   between  year   2,  month   6  measures   and  year  3, 
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month  6   measures).    Changes  in   revision  -frequency   were  based  on 
yearly  average  -frequencies  only. 

The  log  relative  measure  is  conceptually  appealing  because  it 
treats  increases  and  decreases  symmetrically  and  reduces  outlier 
e-f-fects.  But  the  log  relative  measure  is  undefined  when  either 
argument  is  zero  or  negative,  and  a  substantial  number  o-f  disper- 
sion or  bias  measures  in  the  sample  are  zero  or  negative.  The 
absolute  di-f-ference  measure  -fails  to  deflated  -for  size  e-f-fects  but 
can  accommodate  more  o-f  the  observations  available  in  the  sample. 
The  -findings  resulting  from  tests  performed  on  the  two  measures  are 
consistent,  but  slightly  stronger  for  the  absolute  difference 
measure.  Since  the  objective  is  to  identify  measures  that  may 
distinguish  failing  and  healthy  firms,  results  using  the  difference 
measures  are    reported. 

3. 10. 1  Tests  of  Inter— year  Trends 

Two  types  of  tests  were  conducted.  T-tests  were  conducted  to 
answer  the  question  of  whether  mean  year  to  year  trends,  within 
each  group,  were  significantly  different  from  zero.  Wilcoxon  tests 
were  conducted  to  answer  the  question  of  whether  mean  year  to  year 
trends  were  significantly  different  between  groups.  Test  results 
for  changes  from  year  2  to  year  1  prior  to  bankruptcy  are  presented 
in  Table  Tl  (forecast  errors),  Table  T2  (forecast  bias),  Table  T3 
(dispersion),  and  Table  T4  (revision  frequency)  and  Table  T5  (mean 
forecast  level ) . 

Table  Tl  is  consistent  with  expectations.    For   three  out  of 


TABLE  T  1 

YEAR  2  TO  YEAR  1  CHANGE  IN  FORECAST  ERROR 


Error 


AEM 


REM 


PEM 


SEM 


FAILING 

HEALTHY 

WILCOXON 

Month 

MEAN 

t 

. 

MEAN 

t 

a 

Z 

a 

PA 

3.58 

2.46 

.024 

.07 

.52 

.609 

2.23 

.025 

0 

3.65 

2.54 

.019 

.05 

.34 

.731 

2.92 

.004 

3 

4.  11 

2.60 

.017 

.08 

.53 

.598 

1.68 

.093 

6 

5.00 

2.75 

.014 

.  .21 

1.38 

.  174 

1.74 

.082 

9 

4.22 

2.57 

.019 

.30 

1.96 

.056 

1.85 

.064 

PA 

.  JO 

1.05 

.309 

.32 

1.41 

.  163 

.47 

.639 

0 

.02 

.08 

.940 

.  15 

1.06 

.292 

1.45 

.  147 

3 

-.24 

-.48 

.  633 

.74 

1.52 

.  135 

-.63 

.528 

6 

-.55 

-.71 

.485 

1.08 

1.56 

.  124 

-.61 

.543 

9 

-1.37 

-1.30 

.211 

1.37 

1.55 

.  127 

-.80 

.424 

PA 

.57 

3.42 

.003 

.01 

.62 

.541 

4.49 

.000 

0 

4.50 

3.25 

.004 

.37 

3  •  86 

.000 

4.97 

.000 

3 

.  63 

2.43 

.025 

.01 

1.25 

.217 

2.99 

.003 

6 

.89 

2.07 

.055 

.02 

1.89 

.064 

3.93 

.000 

9 

1.00 

2.24 

.037 

.03 

1.92 

.061 

4.32 

.000 

PA 

5.91 

1.99 

.062 

.05 

.  12 

.905 

1.86 

.063 

0 

3.50 

2.20 

.040 

-.04 

-.  13 

.897 

2.22 

.027  • 

3 

3.07 

1.30 

.209 

1.  15 

1.26 

.213 

1.34 

.  181 

6 

2.59 

.68 

.504 

2.48 

1.45 

.  153 

1.05 

.296 



82 


the  -four  error  measures,  the  relative  error  measure  excepted,  there 
is  evidence  of  significant  increase  in  -Forecast  error  -For  the 
-failing  -firm  group.  No  such  significant  trend  is  apparent  for  the 
healthy  firms.  Furthermore,  the  Wilcoxon  tests  indicate  that  the 
increase  in  forecast  errors  Are  significantly  greater  for  the 
failing  firms  as  compared  to  the  healthy  firms.  These  findings  Are 
clearly  strongest  for  the  absolute  error  measures  (AEM)  and  the 
pr i ce— def 1 ated  error  measures  (REM). 

Table  T2  shows  similar  findings  for  the  bias  measures. 
Forecast  errors  Are  significantly  more  negative  in  year  1  than  in 
the  prior  year  2  for  failing  firms.  No  similar  increase  in  bias  is 
apparent  for  the  healthy  group.  Wilcoxon  tests  support  the 
conclusion  that  the  increase  in  negative  forecast  errors  (over— 
estimation)  is  significantly  different  between  the  groups,  particu- 
larly when  differences  Are  determined  using  the  price-deflated 
forecast  error  (PFE)  measures.  As  in  section  3.6,  tests  were 
conducted  using  seven  different  dispersion  measures,  but  as 
findings  were  roughly  consistent  across  the  seven  measures,  results 
for  three  representative  dispersion  measures  Are  reported.  Table 
T3  provides  evidence  of  increasing  dispersion  of  forecasts  for 
failing  firms.  Means  and  t  values  Are  typically  greater  for  the 
failing  groups  than  the  healthy  group  and  several  of  the  t  values 
Are  significant.  Thus  there  is  some  support  for  concluding  that 
dispersion  has  increased  for  the  failing  firms.  Wilcoxon  Z  scores 
Are  consistently  positive  and  predominantly  significant,  thus  the 
increased  dispersion   for  the  failing  group  is  a  trend  not  apparent 


83 


TABLE  T  2 

YEAR  2  TO  YEAR  1  CHANGE  IN  BIAS 


FAILING 


•  HEALTHY 


WILCOXON 


BIAS 


AFE 


RFE 


PFE 


Month 
PA 
0 
3 
6 
9 

PA 

O 

3 

6 

9 


MEAN      t  oc 

-3.48  -2.12  .047 

-3.99  -2.57  .018 

-4.37  -2.61  .017 

-5.08  -2.78  .013 

-4.36  -2.66  .016 


.37 

-.01 

.22 

1.33 


.62 

-.02 
.43 
.67 

1.25 


.543 
.986 
.672 
.509 
.227 


PA 

-.44 

.038 

0 

-4.25 

-2.96 

.008 

3 

-.64 

-2.45 

.024 

6 

-.89 

-2.08 

.053 

9 

-1.00 

-2.26 

.036 

MEAN 
.  13 
.07 
.07 
.07 
.04 

1.72 
1.03 
3.57 
4.96 
6.23 

.07 
.81 
.08 
.09 
.  13 


t 

.87 
.  53 
.45 
.43 
.  19 

.09 
1.28 
1.51 
1.50 
1.50 


<X 

.389 
.597 
.  653 
.667 
.848 

.926 
.205 
.  137 
.  139 
.  140 


z 

a 

-1. 

63 

.  103 

-1. 

89 

.058 

-1. 

46 

.  145 

*-> 

14 

.032 

-2. 

37 

.018 

39 

.692 

45 

.651 

89 

.379 

40 

.687 

71 

.479 

11 

.914 

-2.90 

.  004 

01 

.992 

-3.38 

.001 

65 

.518 

-2.54 

.011 

62 

.  537 

-4 .  09 

.  000 

85 

.399 

-4.44 

.  000 
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TABLE  T  3 

YEAR  2  TO  YEAR  1  CHANGE  IN  DISPERSION 


FAILING 


HEALTHY 


WILCOXON 


Measure   Month 
PA 


STND 
DEV 


VAR/ 
PRICE 


RANGE 


O 

T 
-_» 

6 
9 

PA 

O 

6 
9 

PA 

O 

3 

6 

9 


MEAN 

t 

a 

MEAN 

t 

oc 

Z 

oc 

1.  15 

1.38 

.  189 

.09 

1.27 

.211 

1.42 

.  1  JJ 

.29 

2.08 

.047 

.05 

1.56 

.  125 

1.92 

.054 

.  17 

2.30 

.031 

-.02 

-.43 

.667 

2.67 

.008 

.21 

4.56 

.000 

.02 

.59 

.558 

4.08 

.000 

.  16 

1.52 

.  144 

-.04 

-1.03 

.308 

2.45 

.015 

3.57 

1  .  OO 

.203 

.02 

1.41 

.  164 

2.  13 

.  033 

.  56 

1.22 

.234 

.01 

1.74 

.087 

2.61 

.009 

.OS 

1.94 

.065 

-.00 

-.30 

.769 

3.37 

.001 

.04 

2.77 

.011 

.00 

.20 

.841 

4.83 

.000 

.05 

1.71 

.  102 

-.01 

-1.85 

.071 

3.05 

.002 

1.80 

1.45 

.  169 

.35 

1.59 

.  118 

1.64 

.099 

.59 

2.02 

.054 

.  18 

2.37 

.022 

1.41 

.  159 

.31 

2.44 

.023 

-.01 

-.  12 

.905 

2.30 

.021 

.49 

4.  15 

.000 

.05 

.61 

.546 

2.89 

.  004 

1.94 

.065 

-.11 

-1.06 

.296 

2.42 

.015 
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-for  the  healthy  -firms. 

Table  T4  provides  no  evidences  for  any  year  to  year  trends  in 
the  average  frequency  of  forecast  revisions  for  either  group  nor 
any  difference  between  the  groups. 

Analogous  tests  were  conducted  for  trends  from  year  3  to  year 
2  and  year  4  to  year  3  prior  to  bankruptcy.  Throughout  those  tests 
there  was  no  evidence  of  significant  year  to  year  change  for  either 
group  and  no  evidence  of  any  differences  in  year  to  year  changes 
between  the  two  groups.  This  was  true  for  tests  involving  forecast 
errors,  bias,  dispersion  and  revisions.  Tables  for  those  tests  a.r& 
not  reported  here. 

Table  T5  shows  year  2  to  year  1  trends  in  the  mean  forecasted 
earnings  level  for  both  undeflated  earnings  per  share  and  price 
deflated  earnings  per  share.  For  failing  firms  measures  are 
consistently  negative  indicating  the  declining  level  in  forecasts 
which  was  previously  suggested  by  the  results  reported  in  Table  Ml. 
There  is  evidence  that  the  year  to  year  declines  ar&  significantly 
greater  for  failing  firms  as  compared  to  healthy  firms.  Results  for 
year  3  to  year  2  and  year  4  to  year  3  changes  (not  reported)  also 
provided  statistically  significant  evidence  of  greater  year  to  year 
declines  in  forecast  level  for  failing  firms  when  compared  to 
healthy  firms  for  a  least  some  of  the  monthly  comparisons. 

In  short,  the  set  of  tests  of  year  to  year  trends  supports 
the  following  general  conclusions:  in  the  year  just  prior  to 
bankruptcy   there    is   a   statistically   significant   increase   in 
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TABLE  T  4 

YEAR  2  TO  YEAR  1  CHANGE  IN  YEARLY  AVERAGE  REVISION  FREQUENCY 


UP  REVISION      DOWN  REVISION 
FREQUENCY  CHANGE   FREQUENCY  CHANGE 


TOTAL  REVISIONS 
FREQUENCY  CHANGE 


FAILING  FIRMS 
Mean  Change 


oc 


HEALTHY  FIRMS 
Mean  Change 


a 


FAILING  VS.  HEALTHY 
Wilcox on  Z 


a 


-.001 

.003 

.  002 

-.50 

.44 

.27 

.624 

.664 

.789 

-.000 

.006 

.006 

-.03 

1.40 

1.52 

.975 

.  168 

.  134 

-.879 

-.627 

-.724 

.379 

.  531 

.469 
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TABLE  T  5 


Year  2  to  Year  1  change  in  Mean  Forecast  Level 

Failing  Healthy  Wilcoxon 


Measure 

Unde-flated 
earnings 


Price 
de-f  lated 
earnings 


Month 

Mean 
-1.20 

t 
-1.47 

.153 

Mean 
-.07 

t 
-.49 

a 
.623 

Z 
-3.48 

a 
.001 

PA 

0 

-.08 

-.  15 

.878 

-.03 

-.26 

.796 

-2.53 

.011 

3 

-.07 

-.  16 

.876 

-.01 

-.05 

.960 

-2.73 

.006 

6 

-.  11 

-.23 

.818 

.01 

.  10 

.917 

-2.65 

.008 

9 

-.42 

-1.66 

.  106 

.03 

.30 

.768 

-2.95 

.003 

PA 

-.82 

-2.86 

.008 

-.02 

-1.63 

.108 

-3.85 

.000 

0 

-.24 

-2.31 

.026 

-.01 

-1.  15 

.254 

-2.51 

.012 

3 

-.  12 

-2.13 

.039 

.00 

.50 

.618 

-1.42 

.155 

6 

-.12 

-1.52 

.  136 

.00 

.02 

.984 

-1.42 

.157 

9 

|-06 

-2.34 

.025 

.00 

-.48 

.630 

-1.78 

.075 

■forecast  errors,  increase  in  negative  bias  (over-estimation), 
increase  in  dispersion  across  -forecasts  and  decrease  in  the  level 
o-f    -forecasted    earnings    -for    -firms    -facing    impending    bankruptcy. 

3.11    Summary 

The  preceding  sections  in  this  chapter  have  provided  findings 
on  a  series  o-f  tests  designed  determine  i -f  -failing  -firms  and 
healthy  -firms  di-f-fer  systematically  with  respect  to  various 
properties  of  earnings  forecasts.  Five  specific  properties  were 
investigated: 

a)  Mean  earnings  forecast  estimates 

b)  Forecast  bias 

c)  Forecast  errors 

d)  Dispersion  in  forecasts  across  forecasters 

e)  Frequency  of  revisions  in  forecast  estimates 

In  addition,  tests  were  conducted  to  determine  if  measures  reflec- 
ting the  five  properties  just  listed  changed  significantly  either 
a)  within  a  given  forecast  year  (intra  year  changes)  or  b)  between 
successive  forecast  years  (inter  year  trends);  and  whether  such 
changes  differed  systematically  between  failing  and  healthy  firm 
groups. 

Results  from  the  tests  can  be  summarized  as  follows: 
Mean   forecasts:    Failing   firms   had   lower   mean   earnings 
forecasts  than  healthy  firms  in  years  1-3.   Failing  firms   had  more 
negative   intra-year    changes   in    forecasts   and   more   negative 
intervear  trends  in  forecasts  than  healthy  firms. 
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Bias:  Forecasts  were  more  over-optimistic  (negative  -Forecast 
error)  -for  -failing  -firms  than  -for  healthy  -firms  in  years  1-3.  The 
magnitude  of  the  negative  bias  -for  -failing  -firms  increased  signifi- 
cantly -from  year  2  to  year  1.  The  greater  bias  -for  -failing  firms 
however  could  not  be  attributed  to  -failure  to  use  the  information 
available  in  past  earnings  and  past  errors;  past  earnings  and  error 
information  was  incorporated  into  forecasts  for  both  healthy  and 
f ai 1 i  ng  f  i  rms. 

Accuracy:  Failing  firms  had  consistently  larger  forecast 
errors  for  all  four  years  of  the  study.  Forecasts  for  failing 
firms  were  not  significantly  better  than  a  naive  forecast  of  no 
change  in  earnings.  Within  forecast  years,  accuracy  increased  more 
for  failing  firms  than  healthy  firms  as  the  earnings  announcement 
date  approached  (years  1-3).  Across  years,  there  was  a  significant 
decrease  in  accuracy  for  failing  firms  from  year  2  to  year  1. 

Dispersion:  There  was  greater  dispersion  in  forecasts  for 
failing  firms  during  year  1  and  year  2  prior  to  bankruptcy.  Within 
forecast  years  there  was  mild  evidence  that  dispersion  decreased 
less  for  failing  firms  as  year  end  approached.  Across  years, 
dispersion  increased  for  failing  firms  from  year  2  to  year  1. 

Revisions:  Results  were  least  interesting  for  frequency  of 
revision  measures.  There  was  some  indication  of  greater  frequency 
of  downward  earnings  revisions  for  failing  firms  in  years  1-4. 
There  was  no  indication  of  any  group  differences  in  the  pattern  of 
either  intra— year  or  inter-year  changes  in  revision  frequency. 

While  systematic   groups  differences  exist  to  some  degree  for 
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each  o-f  the  five  properties  o-f  analyst  -forecasts,  the  important 
issue  is  whether  those  di  -f  -f  erences  a.r&  strong  enough  and  stable 
enough  to  be  exploited  -for  predictive  purposes.  The  -following 
chapter  addresses  that  question. 
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CHAPTER  4 
TESTS  OF  DISCRIMINATION  AND  PREDICTION 

4. 1  Introduction 

The  previous  chapter  documented  numerous  systematic 
di  f  f  erences  in  the  properties  o-f  analysts  earnings  forecasts 
between  failing  and  healthy  -firms.  This  chapter  reports  on  both 
univariate  and  multivariate  approaches  to  using  those  properties  to 
discriminate  between  the  groups  and  predict  bankruptcy. 

4. 2  Selecting  measures  to  be  used  in  prediction 

Each  documented  property  may  be  captured  by  various  measures. 
Which  specific  measures  may  be  most  appropriate  for  prediction? 
For  example,  consider  dispersion.  The  findings  indicated  greater 
dispersion  across  forecasts  for  failing  firms,  but  what  specific 
measure  of  dispersion  should  be  selected  and  evaluated  for  its 
predictive  ability?  Seven  different  measures  of  dispersion  were 
introduced  (e.g.  standard  deviation,  range,  log  variance,  etc.). 
And  within  any  given  forecast  year  each  measure  can  be  computed  for 
up  to  24  months  prior  to  the  announcement  of  actual  earnings. 
Thus  to  represent  dispersion  in  any  given  forecast  year,  7x24  or 
16S  possible  measures  exist  to  choose  from. 

Then,  what  if  one  wishes  to  create  a  measure  of  changes  in 
dispersion  within  a  year  (intra— year  changes)?  Section  3.9 
reported  tests   using  10  versions  of  measures  reflecting  intra— year 
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changes.  I-f  those  10  measures  are  computed  -for  each  of  the  seven 
types  o-f  dispersion  measures,  70  possible  intra-year  change  in 
dispersion  variables  result.  And  the  10  versions  o-f  intra-year 
changes  do  not  come  close  to  exhausting  the  possible  pairwise 
combinations  o-f  months  -from  which  intra-year  changes  could  be 
cal cul ated . 

Further,  what  i-f  one  wishes  to  create  a  measure  o-f  changes  in 
dispersion  across  two  successive  years  (inter — year  trends)?  Should 
dispersion  measures  taken  immediately  prior  to  announcement  be 
compared  between  the  two  years?  Should  measures  in  mid  year,  say 
month  six,  be  used?  There  are  as  many  possibilities  as  there  are 
monthly  -forecasts  within  any  -forecast  year. 

Similar  choices  exist  among  the  candidate  measures  -for 
re-flecting  bias,  accuracy,  mean  estimate,  and  revision  -frequency. 
When  one  considers  the  a)  -five  properties  of  interest  b)  the 
various  ways  to  measure  each  o-f  those  properties  c)  the  different 
months  when  forecasts  are  available  for  any  forecast  year,  and  d) 
the  various  pairwise  combinations  of  months  that  may  be  used  to 
create  measures  of  intra-year  changes  or  inter— year  trends,  there 
are  thousands  of  available  measures  that  present  themselves  as 
candidates  for  consideration  in  constructing  a  predictive  model. 
Clearly  a  narrowing  down  of  the  available  measures  to  a  manageable 
subset  to  be  used  in  constructing  predictive  models  is  needed.  The 
following  measures  were  selected  for  inclusion  in  the  subset: 

Notati  on: 
A  =  Actual  earnings 
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F  =  Mean  forecasted  earnings 
Numerical  subscript   =  number   of  months   prior  to   year  end 
within  a  forecast  year. 

t  subscript  =  year  prior  to  bankruptcy. 
Measures: 

1.  Mean  Forecast  (ME)  =  F0.* 

2.  Intra-year  change  in  forecast  (MECHG)  =  F0.^  -  F6,t 

3.  Inter-year  trend  in  forecast  (METRND)  =F0,  t  -F0, .,._,. 

4.  Error  (ERR)=  Fo.-t-A* 

5.  Intra-year  error  change  (ERRCHG)  =  ERR  0,t  -  ERR^.t 

6.  Inter-year  error  trend  (ERRTRND)  =  ERR0.t  -  ERRo.t-x 

7.  Bias  (BIAS)  =  A*  -  F0.t 

8.  Inter-year  trend  in  Bias  =  BI AS0. t-BI AS0. *-i 

9.  Dispersion  (SD)  =  Standard  deviation  of  forecasts  at  month  0. 

10.  Intra-year  change  in  Dispersion  (SDCHG)  =  SDo.t  -  SD&pt 

11.  Inter— year  trend  in  Dispersion  (SDTRND)  =  SDo.-t  —  SD0.t-i 

12   Average  frequency  of  downward  revisions  (DN)  =  percentage  of 
forecasts  revised   downward   during   a   month,   averaged  over 
months  0-1 1 . 

13.  Intra-year  change  in  downward  revisions  (DNCHG)  =  Average 
frequency  of  downward  revisions  over  months  0-5  less  average 
frequency  of  downward  revisions  over  months  6—11. 

14.  Inter— year  trend  in  downward  revision  (DNTRND)  =  DN-t  -  DNt-i 
Several  considerations   were  taken   into  account  in  selecting 

these  measures  for  further  consideration: 

a.   Completeness:    It  was  desired  to  have  the   subset  include 
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measures  representing  each  o-f  the  primary  properties  (level,  bias, 
error,  dispersion,  revisions),  as  well  as  both  intra-year  and 
inter-year  changes  in  those  properties. 

b.  Availability/Sample  size:  Generally  more  -forecasts  per 
-firm  become  available  as  year  end  approaches  and  more  -firms  have 
-forecasts.  Choosing  measures  based  on  month  zero  -forecasts 
increased  sample  size. 

c.  Simplicity:  One  goal  in  developing  a  practical  model  is 
making  it  easy  to  understand  and  use.  Unde-flated  measures  for  ME, 
BIAS,  and  ERR  are  simpler  to  use  and  don't  require  price 
information  for  deflation.  (Tests  were  conducted  and  models 
constructed  using  price-deflated  measures;  findings  and  conclusions 
were  the  same).  The  standard  deviation  (SD)  is  more  understandable 
then  dispersion  measures  such  as  the  log  variance. 

d.  Wilcoxon  tests  results:   High  levels  of  significance  on 
the  previously  reported  wilcoxon  tests  for  group  differences 
suggest  the   potential  for  a  measure  to  have  some  discriminating  or 
predicting  ability.   Thus  measures  were  selected  that   tended  to  be 
associated  with  highly  significant  wilcoxon  tests. 

e.  Correlation:  There  tended  to  be  high  correlations  for  any 
given  measure  across  different  months  within  a  forecast  year. 
There  also  tended  to  be  high  correlation  between  different  measures 
of  a  given  primary  property  taken  from  the  same  month  (e.g. 
standard  deviation  and  range  as  measures  of  dispersion).  Thus  much 
data  reduction,  at  little  cost  in  terms  of  information,  could  be 
accomplished  by   selecting,  even   arbitrarily,  one  measure  for  each 
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property  taken  at  one  month  within  a  given  -forecast  year.  As 
indicated  above  the  simplest  measures  and  month  zero  were  selected, 
-f .  Factor  analysis:  Using  -factor  analysis  is  an  obvious 
data  reduction  technique,  but  it  does  not  provide  de-finitive 
guidance  in  selecting  measures.  When  there  are  thousands  o-f 
measures  available,  computer  program  limitations  are  exceeded. 
Furthermore,  extracted  factors  are  in  part  dependent  on  the  package 
o-f  measures  imputed  to  a  -factor  program.  (For  example  having  seven 
versions  o-f  dispersion  measures  and  only  three  versions  o-f  bias 
measures  may  increase  the  probability  o-f  "dispersion"  factor  being 
identified  by  a  factor  program.)  Factor  analysis  was  conducted  on 
several  j udgemental 1 y  selected  sets  of  variables.  The  final  subset 
of  measures  listed  above  does  adequately  reflect  the  factors 
identifiable  by  factor  analysis. 

4. 3  Univariate  Analysis:  Classification,  Validation  and  Prediction 

As  a  first  step  toward  using  forecast  information  to  predict 
failure,  a  univariate  analysis  was  conducted.  The  approach  used 
follows  Beaver  (1966).  The  procedure  is  straight  forward.  Sample 
firms  were  rank-ordered  independently  on  each  of  the  measures  of 
interest.  The  rank— ordered  values  for  a  given  measure  were 
visually  observed.  A  cutoff  or  threshold  value  of  the  measure  was 
selected  to  divide  sample  observations  into  failing  and  healthy 
firms.  Cutoff  values  were  selected  that  minimized  the  percentage 
of  firms   mi scl assi f i ed .    Results  using   measures  from   year  1  are 
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provided  in  table  Ul. 

Five  items  relating  to  errors  in  classi-f ication  are  provided 
under  the  classification  column  in  table  Ul:  The  type  1  error  is 
the  percentage  o-f  -failing  -firms  miscl  assi-f  i  ed  as  healthy.  The  type 
2  error  is  the  percentage  o-f  healthy  firms  mi  scl  assi  f  i  ed  as 
failing.  The  average  error  is  a  weighted  average  of  the  type  1  and 
type  2  errors  and  thus  represents  the  overall  classification  error 
rate.  The  percentage  in  the  Naive  column  is  provided  as  a 
benchmark  for  comparison.  It  represents  the  frequency  of 
mi sclassi f ication  errors  from  the  following  naive  classification 
rule:  assign  all  firms  to  the  group  (failing  or  healthy)  with  the 
highest  frequency  in  the  sample.  (This  generally  meant  classifying 
all  firms  as  healthy  because  data  limitations  were  such  that 
healthy  firms  outnumbered  failing  firms  in  the  samples  used  to 
develop  the  cutoffs). 

The  final  item  in  the  table  is  a  rough  measure  of  the 
efficiency  (EFF)  of  using  the  cutoff  value  on  a  variable  to 
classify  firms  as  compared  to  using  the  naive  approach.  It  is 
calculated  as  the  error  rate  from  the  naive  approach  minus  the 
error  rate  from  the  cutoff  value  approach  divided  by  the  error  rate 
from  the  naive  approach,  and  thus  measures  the  percentage  of  firms 
that  were  miscl assi f i ed  by  the  naive  approach  that  were  correctly 
classified  by  the  cutoff  value  approach.  EFF  equals  zero  when  the 
naive  and  cutoff  approach  have  the  same  overall  error  rate.  Higher 
positive  values  of  EFF  indicate  increasing  superiority  of  the 
cutoff  approach  over  the  naive  rule,  with  a  value  of  one  indicating 
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no  errors,       in   classification.    Negative  values  indicate  that  the 
cuto-f-f  approach  was  less  successful  than  the  naive  rule. 

Classification  results,  however,  typically  overstate  the 
value  of  an  approach  or  model  in  discriminating  between  two  groups 
since  the  classification  rule  (cutoff  value)  is  applied  to  the  same 
sample  on  which  it  is  developed.  Validation  is  required.  Ideally 
validity  should  be  assessed  on  a  sample  unrelated  to  that  used  to 
develop  the  classification  rule,  a  hold  out  sample.  Operationally 
this  can  be  achieved  by  randomly  dividing  the  sample  into  two 
subsamples,  developing  the  model  or  cutoff  value  on  each  subsample, 
and  using  the  cutoff  from  each  subsample  to  classify  the  firms  in 
the  other  subsample.  Findings  from  using  this  approach  ^re 
contained  in  the  second  set  of  results  under  the  verification 
col umn . 

Another  approach  to  validation  is  to  determine  validity 
across  time.  The  two  remaining  columns  in  the  table,  labeled 
prediction,  show  the  results  of  applying  the  cutoffs  (developed 
from  year  1  measures)  to  the  measures  available  for  sample  firms  in 
year  2  and  year  3. 

Analogous     univariate     classification,    validation    and  ; 
prediction  results  using  year   2  and   year  3   measures  to  determine 
cutoff  values  a.r&    provided  in  tables  L)2  and  U3. 

Several  broad  conclusions  can  be  drawn  from  the  tables. 

a.  The  frequency  of  type  1  errors  is  consistently  greater 
than  the  frequency  of  type  2  errors.  This  is  unfortunate  since  the 
costs  associated   with  type   1  errors  Eir&    likely  to  be  greater  than 
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those  associated  with  type  2  errors.  But  such  results  are  likely 
to  occur  if,  as  in  reality,  the  -frequency  of  healthy  firms  in  a 
sample  is  greater  than  the  frequency  of  failing  firms.  This 
tendency  is  apparent  for  all  models  in  the  study. 

b.  The  classification  accuracy  for  failing  firms  is 
generally  not  good.   Type  1  errors  are  frequently  above  50"/.. 

c.  EFF  values  are  generally  positive  indicating  that  this 
univariate  approach  does  have  some  ability  to  identify  group 
membership.  However,  the  superiority  of  using  cutoff  values  as 
compared  to  the  naive  approach  is  frequently  marginal. 

d.  Regardless  of  which  year  the  cutoffs  are  developed  on, 
there  is  a  tendency  for  discrimination  to  improve  as  the  cutoffs 
are  applied  to  years  closer  to  bankruptcy.  This  is  not  surprising 
since,  if  the  measures  have  any  ability  to  identify  failing  firms, 
the  properties  of  failing  firms  should  be  more  evident  as 
bankruptcy  approaches. 

e.  The  cutoffs  developed  from  year  3  measures  tend  to 
perform  most  poorly. 

f.  Across  the  classification,  validation  and  prediction 
tests,  and  across  the  three  years,  the  ME  measure  appears  to 
perform  best.  Average  error  rates  tend  to  be  low  and  efficiency 
rates  relatively  high.  The  ability  of  a  cutoff  based  on  ME  to 
outperform  the  naive  approach  tends  to  be  the  most  consistent 
across  the  validation  and  prediction  tests  and  across  the  years. 

In  summary,  one  would  like  to  have  a  measure  (or  measures) 
that    a)  is   valid  in   that  it   performs  well   on  the  verification 
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tests  and  b)  is  consistent,  in  that  it  performs  well  in  more  than 
one  year  prior  to  bankruptcy,  i.e.,  performs  well  in  the  prediction 
tests.  Overall,  measure  ME  performs  best.  Regardless  of  the  year 
(1,2,  or  3)  in  which  the  cutoff  value  is  determined,  use  of  ME 
allows  for  a  discrimination  of  firms  in  the  two  years  prior  to 
bankruptcy  which  is  markedly  better  than  a  naive  rule.  Efficiency 
indicators  suggest,  that  about  40/C  of  firms  mi  scl  assi  f  i  ed  by  the 
naive  rule  can  be  correctly  classified  using  a  cutoff  based  on  ME. 

4. 4  Multiple  Discriminant  Models 

By  far  the  most  popular  methodological  approach  to  developing 
bankruptcy  prediction  models  has  been  multiple  discriminant 
analysis.  (See  Zavgren  C1983D  for  a  review.)  Discriminant 
analysis  is  a  statistical  procedure  that  creates  a  linear 
combination  of  several  discriminating  variables  that  can  then  be 
used  to  assign  a  score  to  an  individual  observation  or  firm.  The 
discriminant  score  is  then  used  to  classify  firms  into  groups. 
Stepwise  selection  procedures  can  be  used  to  identify  the 
particular  set  of  discriminating  variables,  from  a  larger  set  of 
potential  discriminating  variables,  that  in  combination  most 
effectively  predicts  group  membership.  Stepwise  multiple 
discriminant  analysis  was  used  to  develop  some  multivariate  models 
for  predicting  failure. 

Stepwise  discriminant  analysis  is  an  approach  involving  both 
analytic  and  heuristic  aspects.  The  model  that  results  from 
applying  the   stepwise  discriminant  procedure  depends  on  the  set  of 
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variables  the  procedure  is  allowed  to  select  -from  and  the  selection 
criteria.  Both  are  choices  o-f  the  model  builder.  Hence  the 
individual  model  that  results  may  not  necessarily  be  optimal. 
However,  by  creating  various  models  iteratively,  models  that 
apparently  make  the  best  use  o-f  the  data  to  distinguish  groups  can 
be  identified.  In  this  study  models  were  developed  by  allowing  the 
stepwise  procedure  to  select  -from  among  three  di-f-ferent  sets  o-f 
measures. 

1.  All  variables  (i.e.  the  14  listed  in  Section  4.2) 

2.  Primary  Variables  only  (i.e.  ERR,  BIAS,  SD,  ME,  DN,  but 
no  intra-year  change  or  inter-year  trend  measures) 

3.  Factor  Variables:  A  subset  o-f  all  variables  identified  by 
-factor  analysis  as  representing  the  major  dimensions  of 
variability  in  the  data. 

Given  a  particular  discriminant  model,  there  are  various 
indicators  of  its  ability  to  discriminate  groups.   For  example: 

1.  Classification  error  rates.  The  percentage  of  firms  mis- 
classified  by  the  model. 

2.  Cannonical  Correlation.  A  measure  of  association  between 
the  linear  discriminant  function  and  the  groups  to  be 
discriminated. 

3.  Significance  of  the  model. 

A  "best"  model  developed  from  each  of  the  three  different 
sets  of  allowable  variables  mentioned  above  was  developed  from 
measures  from  years  1—3,  resulting  in  nine  models.  However  the 
three   models   constructed   using   year   3   measures   were   all  one 
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variable  models.  They  are  in  essence  analogous  to  the  univariate 
approach  and  consequently  are  not  reported  here.  Also  the  "factor" 
model  developed  -from  year  2  measures  was  the  same  as  the  "all 
variables"  model  and  hence  is  redundant.  The  remaining  -five  models 
are    reported  in  tables  Ml  through  M5. 

As  with  the  univariate  approach  each  model  was  validated  by 
splitting  the  sample  in  hal-f,  fitting  the  model  to  each  subsample 
to  generate  coefficients  and  then  classifying  the  firms  in  the 
opposite  subsample.  Also  as  with  the  univariate  approach,  models 
developed  on  measures  from  one  year  were  applied  to  measures  from 
the  other  two  years  to  predict  the  group  membership  from 
observations  in  those  years. 

The  all-variables  model  from  year  1  data  (Table  Ml)  appears 
at  first  glance  to  be  very  good.  No  firms  are  mi scl assi f i ed  when 
the  model  is  fit  to  the  full  sample  and  the  split-sample  validation 
results  still  show  only  a  2.V.  overall  error  rate.  (Consequently 
efficiency  is  quite  high,  1.00  and  .91  respectively.)  However, 
when  the  model  is  applied  to  measures  from  the  other  years 
prediction  of  group  membership  is  no  better  (or  worse)  than  the 
naive  classification  rule.  There  are  apparently  some  relationships 
between  the  variables  included  in  the  model  that  are  unique  to  the 
measures  taken  from  year  1.  This  is  a  problem  with  multiple 
discriminant  analysis.  Correlation  or  inter-relationships  between 
the  measures  that  are  unique  to  the  data  on  which  the  model  is 
developed,  and  which  prove  useful  in  distinguishing  that  set  of 
observations,  may   not  hold   when  the   model  is   used  to  classify  a 
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TABLE 


M  1 


MEASURE 


YEAR  1  MODEL  -  ALL  VARIABLES 

STANDARDIZED 
COEFFICIENT 


UNSTND. 
COEFFICIENT 


ERRCHG 

SDTRND 

BIAS 

BTRND 

ME 

MECHG 

DNTRND 

DNCHG 

CONSTANT 


1.02 

-4.  18 

3.04 

1.68 
— .  56 

.53 

X 


.50 

5.  14 

-.94 

.65 

.28 

68 


-1 


-14.67 
12.37 
-2.49 


Cannonical  Correlation    :  .88 

Likelihood  Ratio  (Wilks  Lambda):      .217 
F  Statistic  :  17.99 

Alpha  Level  :    -.0000 


YEAR  1  YEAR  2 

Classification   Verification   Prediction 


YEAR  3 
Predi  cti  on 


FAILED  FIRMS 


"/.  Correct 
V.    Incorrect 


100 
0 


92 
8 


75 


0 
100 


HEALTHY  FIRMS 


V.    Correct 
7.  Incorrect 


100 
0 


100 
0 


87.5 
12.5 


96 
4 


ALL  FIRMS 


V.    Correct 

7.  Naive  Correct 

EFFICIENCY 


100 
73 

1.00 


98 
73 

.91 
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67 
67 


00 


67 
69 


.06 


TABLE    M  2 
YEAR  1   MODEL  -  PRIMARY  VARIABLES 


MEASURE 


ERR 

SD 

BIAS 

ME 

CONSTANT 


STANDARDIZED 

COEFFICIENT 

.48 

.71 

-.28 

-.36 

X 

UNSTND. 
COEFFICIENT 


.  12 
1.25 


-.07 

-.  18 

-1.84 


Cannonical  Correlation 
Likelihood  Ratio  (Wilks  Lambda) 
F  Statistic 
Alpha  Level 


68 


*   wJ-_'  _' 


12.47 
.0000 


YEAR  1  YEAR  2 

Classification   Veri  -f  i  cati  on   Prediction 


YEAR  3 
Predi  ct i  on 


FAILED  FIRMS 


7.    Correct 
"/.  Incorrect 


57 
43 


64 
36 


19 

81 


0 

100 


HEALTHY  FIRMS 


7.    Correct 
7.  Incorrect 


100 
0 


85 
15 


100 
0 


98 
2 


ALL  FIRMS 


7.  Correct 

"/.  Naive  Correct 


90 
77 


81 
77 


83 
66 


63 
65 


EFFICIENCY 


56 


.  17 


iO 


06 
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TABLE  M  3 
YEAR  1  MODEL-  VARIABLES  FROM  FACTOR  ANALYSIS 


MEASURE 

SD 

SDCHG 

BIAS 

ERRTRND 

DNTRND 

CONSTANT 


STANDARDIZED 
COEFFICIENT 

2.54 
-1.95 
-3.  14 
-2.  12 

-.  12 
X 


UNSTND. 

COEFFICIENT 

4. 

25 

-3. 

,57 

-. 

70 

-. 

46 

o  ■ 

05 

-2. 

58 

Cannonical  Correlation 
Likelihood  Ratio  (Wilks  Lambda) 
F  Statistic 
Alpha  Level 


.81 
.343 
16.09 
.0000 


YEAR  1  YEAR  2 

Classification   Verification   Prediction 


YEAR  3 
Predi  cti  on 


FAILED  FIRMS 


7.  Correct 
"/.  Incorrect 


92 
8 


83 
17 


20 
80 


7 
93 


HEALTHY  FIRMS 


V.    Correct 
'/.  Incorrect 


97 


94 
6 


86 
14 


87 
13 


ALL  FIRMS 


7.  Correct 

7.  Naive  Correct 


96 

75 


92 
75 


63 
65 


60 
67 


EFFICIENCY 


.84 


.68 


-.06 


21 
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di-f-Ferent  set.  The  model  is  "over-fit"  to  the  data.  Use  of  -Factor 
analysis  to  reduce  correlation  between  the  independent  variables 
might  be  expected  diminish  the  problem,  but  the  results  -for  the 
-factor  model  (Table  M3)  are  also  poor.  When  applied  to  the  off- 
years  (prediction  on  years  2  and  3)  the  factor  model  is  poorer  then 
the  naive  prediction  rule. 

Overall  error  rates  increase  and  efficiency  relative  to  the 
naive  rule  decreases  for  all  models  in  the  off-years  (except  for 
model  M2  when  applied  to  year  2).  In  fact  all  models  have  a  higher 
error  rate  than  the  naive  rule  when  applied  to  year  3  data. 

Both  models  fitted  on  year  2  data  (Tables  M4  and  M5)  are  no 
better,  and  perhaps  worse,  than  the  univariate  approach  using 
variable  ME.  If  we  discount  them  for  that  reason,  we  a.re  left  with 
the  three  models  developed  on  year  one  data,  and  their  ability  to 
discriminate  firms  well  is  apparently  limited  to  the  year 
immediately  prior  to  bankruptcy.  Yet  even  that  conclusion  may  be 
questioned.  The  classification  results  are  good  (particularly  for 
Ml  and  M3)  but  the  verification  results  are  poorer.  And  there  is  a 
bias  toward  achieving  high  verification  results.  Unlike  the 
univariate  approach  the  discriminant  approach  uses  the  information 
in  the  data  itself  to  select  the  best  discriminating  variables. 
The  split-sample  validation  procedure  forms  new  linear  combinations 
of  the  variables  in  each  subsample,  which  is  then  used  to  classify 
firms  in  the  opposite  subsample.  The  variable  coefficients  of  the 
models  developed  in  each  subsample  are  of  course  unaffected  by  the 
information  contained   in  the   opposite  subsample   but  the  specific 
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TABLE  M4 
YEAR  2  MODEL  -  ALL  VARIABLES 


MEASURE 

SDCHG 
MECHG 
DNTRND 
CONSTANT 


Cannonical  Correlation 
Likelihood  Ratio  (Wilks  Lambda) 
F  Statistic 
Alpha  Level 


STANDARDIZED 
COEFFICIENT 


-1.09 
-2.03 
-.44 
X 

.42 

.S3 

4.3S 

.007 

UNSTND. 
COEFFICIENT 

-.92 

-1.25 

-10.03 

-.93 


FAILED  FIRMS 


YEAR  2  YEAR  1         YEAR  3 

Classification  Verification  Prediction    Predictioi 


7.    Correct 
"/.  Incorrect 


48 


41 
59 


59 
41 


12 

88 


HEALTHY  FIRMS 


V.    Correct 
V.    Incorrect 


92.5 
7.5 


95 


82 
18 


82.5 
12.5 


ALL  FIRMS 

"/.  Correct 

V.    Naive  Correct 

EFFICIENCY 


75 

60 


.38 


73 

60 


74 
67 


61 

65 


-.  11 
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TABLE  M5 
YEAR  2  MODEL-PRIMARY  VARIABLES 


MEASURE 


STANDARDIZED 
COEFFICIENT 


UNSTND. 
COEFFICIENT 


SD 
ME 
CONSTANT 


-.07 
-1.  12 
X 


-.59 

-.06 

.24 


Cannonical  Correlation  :    .40 

Likelihood  Ratio  (Wilks  Lambda):    .837 

F  Statistic  :  8.54 

Alpha  Level  :    .0004 


YEAR  2  YEAR  1        YEAR  3 

CI  assi  -f  i  cat  i  on  Verification  Prediction    Prediction 


FAILED  FIRMS 


'/.    Correct 
7.  Incorrect 


42 

58 


56 
44 


63 
37 


11 
89 


HEALTHY  FIRMS 

"/.  Correct 
"/.  Incorrect 

ALL  FIRMS 


93 

7 


85 
15 


86 
14 


91 
9 


7.  Correct 

7.  Naive  Correct 


73 

60 


74 
60 


78 
67 


61 

63 


EFFICIENCY 


.  OO 


o: 


in 


variabl  es  to  be  included  in  the  model  are  not.  The  -fact  that  the 
-full  sample  is  used  originally  to  select  the  variables  implies  that 
the  variables  should  have  some  discriminating  ability  in  both 
subsamples  even  if  the  speci-fic  way  in  which  the  variables  are 
joined  in  a  linear  combinations  is  subsample  speci-fic. 

Another  problem  is  also  evident.  The  results  are  reported  in 
the  tables  such  that  higher  discriminant  scores  are  associated  with 
-failing  -firms.  But  coefficient  signs  for  individual  variables  are 
not  always  as  one  would  expect  for  some  of  the  measures.  For 
example  in  model  Ml,  variable  ME  has  a  positive  sign,  while  the 
univariate  results,  and  common  sense,  indicate  that  failing  firms 
should  have  lower  forecasted  earnings.  This  suggests  that  ME  is  in 
the  model  because  of  some  unique  interrelationship  among  the 
variables  that  may  be  peculiar  to  the  year  1  data. 

In  summary  there  is  reason  to  question  the  value  of  the 
discriminant  approach.  Models  developed  on  year  3  data  were  single 
variable  models  and  hence  no  better  then  the  univariate  approach. 
Models  developed  on  year  2  data  did  not  perform  better  than 
individual  measures  reported  from  the  univariate  approach.  And 
models  developed  from  year  1  data  can  be  criticized.  While  the 
classification  error  rates  are  low,  they  don't  perform  well  when 
applied  to  data  from  other  years  and  their  validity  can  be 
quest i  oned. 

4.5  Conclusions 

The   purpose   of   this   study   was   to   determine   if  various 
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measures  developed  -from  -financial  analysts  -forecasts  o-f  earnings 
-for  -firms  could  be  exploited  in  predicting  -future  bankruptcy.  The 
study  consisted  o-f  two  major  parts. 

In  the  -first  part  (Chapter  3)  the  properties  o-f  analysts 
forecasts  were  discussed  and  measures  were  developed  to  reflect 
these  properties.  Five  properties  were  investigated:  forecast 
level,  -forecast  dispersion,  forecast  error,  -forecast  bias  and 
-forecast  revisions.  Various  tests  were  conducted  to  determine  i  -f 
there  were  systematic  differences  in  the  properties  for  failing 
firms  as  compared  to  healthy  firms  in  years  prior  to  the  bankruptcy 
of  the  failing  firms.  Several  statistically  significant 
differences  were  apparent.  Failing  firms  tended  to  be  associated 
with  lower  forecasted  earnings,  higher  dispersion  in  earnings 
forecasts  across  forecasters,  greater  error  in  forecasts,  over- 
optimistic  forecasts,  and  perhaps  greater  frequency  of  downward 
revisions  in  forecast  estimates.  Some  differences  between  failing 
and  healthy  firms  in  both  intra-year  and  inter — year  changes  in  the 
measures  were  also  noted. 

In  the  second  part  of  the  study  (Chapter  4)  measures 
reflecting  aspects  of  the  five  properties  were  used  to  discriminate 
failing  from  healthy  firms.  Both  univariate  and  multivariate 
approaches  were  attempted.  Measures  and  linear  combinations  of 
measures  were  able  to  out-predict  a  naive  model  in  distinguishing 
between  groups.  However,  overall  results  were  not  encouraging.  It 
was  possible  to  develop  multivariate  models  that  were  highly 
successful   in   classifying   firms   but   these    models   were   less 
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success-ful  in  predicting  group  membership  when  applied  to  data 
taken  -from  different  years  prior  to  bankruptcy,  and  were  of 
questionable  validity.  Individual  measures  were  more  consistent 
across  time  in  identifying  failing  firms  from  healthy  firms. 
Perhaps  the  single  best  approach  identified  for  using  measures 
taken  from  analyst  forecasts  for  predicting  failure  was  to  look  at 
the  mean  forecasted  value  of  future  earnings.  Simply  put  failing 
firms  were  predicted  to  have  lower  earnings.  An  approach  where 
firms  with  forecasted  earnings  below  a  particular  cutoff  point  were 
classified  as  facing  bankruptcy  was  able  to  correctly  classify  from 
22X  to  40X  (depending  on  the  year  prior  to  bankruptcy)  of  firms 
that  were  misclassif ied  using  the  naive  rule  (which  classified  all 
firms  as  healthy).  While  the  results  indicate  some  ability  of 
forecast  data  to  assist  in  the  prediction  of  failure,  the  ability 
to  exploit  analyst  forecast  data  in  predicting  failure  does  not 
appear  to  be  great.  The  fact  that  there  is  an  association  between 
lower  forecasted  future  earnings  and  future  bankruptcy  is  not 
surprising  and  does  not  appear  to  provide  any  novel  insight  that 
may  be  exploited  for  predicting  bankruptcy. 

Two  directions  for  future  research  could  change  these 
conclusions.  First,  if  the  multiple  discriminant  models  that  had 
high  classification  success  in  this  study  were  validated  on  other 
sets  of  data  and  found  not  to  be  unique  to  the  observations  in  this 
study,  then  the  conclusion  that  analyst  forecasts  do  contain 
information  particularly  suitable  to  predicting  failure  would 
. follow.    Second,  perhaps   other  approaches  to  model  building,  such 
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as  the  construction  o-f  a  "-failure  index"  (e.g.  Moses  and  Liao 
C1986U)  may  better  exploit  the  in-formation  available  in  forecast 
data  -for  predicting  -failure. 
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